Hugging Face's logo

qualcomm
/
Track-Anything

PyTorch
android
video-object-tracking
Model card Files
xet
 Community

YAML Metadata Warning:The pipeline tag "video-object-tracking" is not in the official list: text-classification, token-classification, table-question-answering, question-answering, zero-shot-classification, translation, summarization, feature-extraction, text-generation, fill-mask, sentence-similarity, text-to-speech, text-to-audio, automatic-speech-recognition, audio-to-audio, audio-classification, audio-text-to-text, voice-activity-detection, depth-estimation, image-classification, object-detection, image-segmentation, text-to-image, image-to-text, image-to-image, image-to-video, unconditional-image-generation, video-classification, reinforcement-learning, robotics, tabular-classification, tabular-regression, tabular-to-text, table-to-text, multiple-choice, text-ranking, text-retrieval, time-series-forecasting, text-to-video, image-text-to-text, image-text-to-image, image-text-to-video, visual-question-answering, document-question-answering, zero-shot-image-classification, graph-ml, mask-generation, zero-shot-object-detection, text-to-3d, image-to-3d, image-feature-extraction, video-text-to-text, keypoint-detection, visual-document-retrieval, any-to-any, video-to-video, other

Track-Anything: Optimized for Qualcomm Devices

Track-Anything is a video based machine learning model to track an object in a video.

This is based on the implementation of Track-Anything found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.45, ONNX Runtime 1.25.0 Download
TFLITE float Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit Track-Anything on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for Track-Anything on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.video_object_tracking

Model Stats:

  • Model checkpoint: xmem
  • Input resolution: 320x568
  • Number of parameters (encode_key_with_shrinkage): 9.72M
  • Model size (encode_key_with_shrinkage) (float): 37.1 MB
  • Number of parameters (encode_value): 23.3M
  • Model size (encode_value) (float): 88.8 MB
  • Number of parameters (encode_key_without_shrinkage): 9.71M
  • Model size (encode_key_without_shrinkage) (float): 37.1 MB
  • Number of parameters (segment): 30.1M
  • Model size (segment) (float): 115 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
encode_key_with_shrinkage ONNX float Snapdragon® X2 Elite 2.778 ms 10 - 10 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® X Elite 5.262 ms 18 - 18 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Gen 3 Mobile 3.693 ms 1 - 200 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Gen 1 Mobile 10.586 ms 9 - 189 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.178 ms 8 - 10 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® QCS8450 10.586 ms 9 - 189 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-9075 8.79 ms 8 - 11 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Elite Gen 5 Mobile 2.38 ms 0 - 172 MB NPU
encode_key_with_shrinkage ONNX float Snapdragon® 8 Elite Mobile 3.0 ms 0 - 172 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ Q-8750 3.0 ms 0 - 172 MB NPU
encode_key_with_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-X7181 5.262 ms 18 - 18 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Gen 3 Mobile 4.067 ms 0 - 213 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Gen 1 Mobile 11.789 ms 3 - 200 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® QCS8275 123.75 ms 4 - 23 MB GPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.92 ms 0 - 91 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA8775P 9.463 ms 3 - 180 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA8650P 9.463 ms 3 - 180 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA8255P 9.463 ms 3 - 180 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® QCS8450 11.789 ms 3 - 200 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-9075 9.183 ms 2 - 29 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.46 ms 0 - 184 MB NPU
encode_key_with_shrinkage TFLITE float Snapdragon® 8 Elite Mobile 3.285 ms 0 - 183 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA7255P 123.75 ms 4 - 23 MB GPU
encode_key_with_shrinkage TFLITE float Qualcomm® SA8295P 10.299 ms 3 - 163 MB NPU
encode_key_with_shrinkage TFLITE float Qualcomm® Dragonwing™ Q-8750 3.285 ms 0 - 183 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® X2 Elite 3.85 ms 80 - 80 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® X Elite 6.835 ms 80 - 80 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Gen 3 Mobile 5.067 ms 54 - 254 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Gen 1 Mobile 13.535 ms 50 - 251 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.816 ms 42 - 62 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® QCS8450 13.535 ms 50 - 251 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-9075 10.627 ms 54 - 57 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.47 ms 1 - 178 MB NPU
encode_key_without_shrinkage ONNX float Snapdragon® 8 Elite Mobile 4.363 ms 51 - 246 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ Q-8750 4.363 ms 51 - 246 MB NPU
encode_key_without_shrinkage ONNX float Qualcomm® Dragonwing™ IQ-X7181 6.835 ms 80 - 80 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Gen 3 Mobile 5.609 ms 19 - 236 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Gen 1 Mobile 14.26 ms 20 - 222 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® QCS8275 33.59 ms 20 - 203 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 7.708 ms 18 - 20 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA8775P 11.686 ms 20 - 207 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA8650P 11.686 ms 20 - 207 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA8255P 11.686 ms 20 - 207 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® QCS8450 14.26 ms 20 - 222 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ IQ-9075 11.335 ms 20 - 63 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 3.569 ms 0 - 221 MB NPU
encode_key_without_shrinkage TFLITE float Snapdragon® 8 Elite Mobile 4.409 ms 20 - 204 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA7255P 33.59 ms 20 - 203 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® SA8295P 12.669 ms 20 - 184 MB NPU
encode_key_without_shrinkage TFLITE float Qualcomm® Dragonwing™ Q-8750 4.409 ms 20 - 204 MB NPU
encode_value ONNX float Snapdragon® X2 Elite 6.553 ms 20 - 20 MB NPU
encode_value ONNX float Snapdragon® X Elite 13.228 ms 39 - 39 MB NPU
encode_value ONNX float Snapdragon® 8 Gen 3 Mobile 11.343 ms 0 - 210 MB NPU
encode_value ONNX float Snapdragon® 8 Gen 1 Mobile 31.657 ms 12 - 210 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 16.641 ms 0 - 44 MB NPU
encode_value ONNX float Qualcomm® QCS8450 31.657 ms 12 - 210 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ IQ-9075 18.93 ms 6 - 14 MB NPU
encode_value ONNX float Snapdragon® 8 Elite Gen 5 Mobile 8.254 ms 7 - 180 MB NPU
encode_value ONNX float Snapdragon® 8 Elite Mobile 9.555 ms 7 - 191 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ Q-8750 9.555 ms 7 - 191 MB NPU
encode_value ONNX float Qualcomm® Dragonwing™ IQ-X7181 13.228 ms 39 - 39 MB NPU
encode_value TFLITE float Snapdragon® 8 Gen 3 Mobile 8.224 ms 2 - 287 MB NPU
encode_value TFLITE float Snapdragon® 8 Gen 1 Mobile 21.39 ms 3 - 291 MB NPU
encode_value TFLITE float Qualcomm® QCS8275 51.307 ms 3 - 217 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.902 ms 3 - 6 MB NPU
encode_value TFLITE float Qualcomm® SA8775P 17.01 ms 3 - 215 MB NPU
encode_value TFLITE float Qualcomm® SA8650P 17.01 ms 3 - 215 MB NPU
encode_value TFLITE float Qualcomm® SA8255P 17.01 ms 3 - 215 MB NPU
encode_value TFLITE float Qualcomm® QCS8450 21.39 ms 3 - 291 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ IQ-9075 16.809 ms 0 - 55 MB NPU
encode_value TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 5.407 ms 2 - 203 MB NPU
encode_value TFLITE float Snapdragon® 8 Elite Mobile 6.842 ms 0 - 210 MB NPU
encode_value TFLITE float Qualcomm® SA7255P 51.307 ms 3 - 217 MB NPU
encode_value TFLITE float Qualcomm® SA8295P 18.738 ms 3 - 221 MB NPU
encode_value TFLITE float Qualcomm® Dragonwing™ Q-8750 6.842 ms 0 - 210 MB NPU
segment ONNX float Snapdragon® X2 Elite 11.67 ms 21 - 21 MB NPU
segment ONNX float Snapdragon® X Elite 23.214 ms 38 - 38 MB NPU
segment ONNX float Snapdragon® 8 Gen 3 Mobile 17.492 ms 0 - 241 MB NPU
segment ONNX float Snapdragon® 8 Gen 1 Mobile 42.918 ms 1 - 230 MB NPU
segment ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 23.149 ms 0 - 317 MB NPU
segment ONNX float Qualcomm® QCS8450 42.918 ms 1 - 230 MB NPU
segment ONNX float Qualcomm® Dragonwing™ IQ-9075 34.374 ms 21 - 45 MB NPU
segment ONNX float Snapdragon® 8 Elite Gen 5 Mobile 10.835 ms 3 - 216 MB NPU
segment ONNX float Snapdragon® 8 Elite Mobile 13.309 ms 5 - 213 MB NPU
segment ONNX float Qualcomm® Dragonwing™ Q-8750 13.309 ms 5 - 213 MB NPU
segment ONNX float Qualcomm® Dragonwing™ IQ-X7181 23.214 ms 38 - 38 MB NPU
segment TFLITE float Snapdragon® 8 Gen 3 Mobile 17.349 ms 2 - 291 MB NPU
segment TFLITE float Snapdragon® 8 Gen 1 Mobile 42.127 ms 2 - 295 MB NPU
segment TFLITE float Qualcomm® QCS8275 103.338 ms 2 - 195 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 23.461 ms 2 - 4 MB NPU
segment TFLITE float Qualcomm® SA8775P 33.309 ms 2 - 193 MB NPU
segment TFLITE float Qualcomm® SA8650P 33.309 ms 2 - 193 MB NPU
segment TFLITE float Qualcomm® SA8255P 33.309 ms 2 - 193 MB NPU
segment TFLITE float Qualcomm® QCS8450 42.127 ms 2 - 295 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ IQ-9075 34.301 ms 0 - 83 MB NPU
segment TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 11.582 ms 0 - 196 MB NPU
segment TFLITE float Snapdragon® 8 Elite Mobile 13.194 ms 0 - 195 MB NPU
segment TFLITE float Qualcomm® SA7255P 103.338 ms 2 - 195 MB NPU
segment TFLITE float Qualcomm® SA8295P 37.5 ms 2 - 202 MB NPU
segment TFLITE float Qualcomm® Dragonwing™ Q-8750 13.194 ms 0 - 195 MB NPU

License

  • The license for the original implementation of Track-Anything can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/Track-Anything