Image Segmentation
PyTorch
foundation
android
EdgeTAM / README.md
qaihm-bot's picture
v0.62.2
c416097 verified
|
Raw
History Blame Contribute Delete
31.1 kB
metadata
library_name: pytorch
license: apache-2.0
tags:
  - foundation
  - android
pipeline_tag: image-segmentation

EdgeTAM: Optimized for Qualcomm Devices

EdgeTAM is a lightweight and efficient version of SAM 2, optimized for on-device tracking and segmenting any object in videos and low memory usage by using a novel 2D Spatial Perceiver and RepViT backbone.

This is based on the implementation of EdgeTAM found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
ONNX w8a8 Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
QNN_DLC float Universal QAIRT 2.45 Download
QNN_DLC w8a8 Universal QAIRT 2.45 Download
TFLITE float Universal QAIRT 2.45 Download
TFLITE w8a8 Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit EdgeTAM on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for EdgeTAM on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.semantic_segmentation

Model Stats:

  • Input resolution (Encoder): 1024x1024
  • Model checkpoint: edgetam.pt
  • Model size (encoder) (float): 33 MB
  • Model size (memory_encoder) (float): 4.6 MB
  • Model size (video_decoder) (float): 23.7 MB
  • Number of parameters (encoder): 8.3M
  • Number of parameters (memory_encoder): 1.2M
  • Number of parameters (video_decoder): 6.22M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
encoder ONNX float Snapdragon® X2 Elite 11.6 ms 70 - 70 MB NPU
encoder ONNX float Snapdragon® X Elite 17.919 ms 70 - 70 MB NPU
encoder ONNX float Snapdragon® 8 Gen 3 Mobile 13.903 ms 56 - 408 MB NPU
encoder ONNX float Snapdragon® 8 Gen 1 Mobile 91.759 ms 27 - 442 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-8275 24.207 ms 12 - 16 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 18.152 ms 40 - 42 MB NPU
encoder ONNX float Qualcomm® QCS8450 91.759 ms 27 - 442 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-9075 22.546 ms 12 - 15 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 17.919 ms 70 - 70 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ Q-8750 9.524 ms 45 - 363 MB NPU
encoder ONNX float Snapdragon® 8 Elite Mobile 9.524 ms 45 - 363 MB NPU
encoder ONNX float Snapdragon® 8 Elite Gen 5 Mobile 7.969 ms 45 - 383 MB NPU
encoder ONNX w8a8 Snapdragon® X2 Elite 3.187 ms 18 - 18 MB NPU
encoder ONNX w8a8 Snapdragon® X Elite 8.186 ms 18 - 18 MB NPU
encoder ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 5.329 ms 15 - 310 MB NPU
encoder ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 2247.698 ms 9 - 326 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 4487.562 ms 3 - 6 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 7.57 ms 12 - 16 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 7.907 ms 10 - 17 MB NPU
encoder ONNX w8a8 Qualcomm® QCS8450 2247.698 ms 9 - 326 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 8.424 ms 12 - 15 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 8.186 ms 18 - 18 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 57.622 ms 7 - 259 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 10.655 ms 15 - 272 MB NPU
encoder ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 4.475 ms 13 - 272 MB NPU
encoder ONNX w8a8 Snapdragon® 8 Elite Mobile 4.475 ms 13 - 272 MB NPU
encoder ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 3.056 ms 2 - 280 MB NPU
encoder ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 10.655 ms 15 - 272 MB NPU
encoder QNN_DLC float Snapdragon® X2 Elite 10.465 ms 12 - 12 MB NPU
encoder QNN_DLC float Snapdragon® X Elite 23.498 ms 12 - 12 MB NPU
encoder QNN_DLC float Snapdragon® 8 Gen 3 Mobile 16.713 ms 47 - 387 MB NPU
encoder QNN_DLC float Snapdragon® 8 Gen 1 Mobile 99.585 ms 12 - 421 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 27.141 ms 12 - 46 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 23.38 ms 12 - 18 MB NPU
encoder QNN_DLC float Qualcomm® SA8775P 27.47 ms 0 - 258 MB NPU
encoder QNN_DLC float Qualcomm® SA8650P 27.47 ms 0 - 258 MB NPU
encoder QNN_DLC float Qualcomm® SA8255P 27.47 ms 0 - 258 MB NPU
encoder QNN_DLC float Qualcomm® QCS8450 99.585 ms 12 - 421 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 28.716 ms 12 - 46 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 23.498 ms 12 - 12 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 11.644 ms 0 - 276 MB NPU
encoder QNN_DLC float Qualcomm® SA7255P 68.705 ms 1 - 259 MB NPU
encoder QNN_DLC float Qualcomm® SA8295P 53.597 ms 1 - 336 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite Mobile 11.644 ms 0 - 276 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 8.941 ms 11 - 312 MB NPU
encoder QNN_DLC w8a8 Snapdragon® X2 Elite 4.29 ms 3 - 3 MB NPU
encoder QNN_DLC w8a8 Snapdragon® X Elite 11.653 ms 3 - 3 MB NPU
encoder QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 7.348 ms 3 - 302 MB NPU
encoder QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 2275.274 ms 3 - 327 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 4492.71 ms 1 - 11 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 10.199 ms 2 - 12 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 10.864 ms 3 - 172 MB NPU
encoder QNN_DLC w8a8 Qualcomm® SA8775P 11.555 ms 3 - 260 MB NPU
encoder QNN_DLC w8a8 Qualcomm® SA8650P 11.555 ms 3 - 260 MB NPU
encoder QNN_DLC w8a8 Qualcomm® SA8255P 11.555 ms 3 - 260 MB NPU
encoder QNN_DLC w8a8 Qualcomm® QCS8450 2275.274 ms 3 - 327 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 11.676 ms 1 - 11 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 11.653 ms 3 - 3 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 55.605 ms 5 - 238 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 11.559 ms 3 - 264 MB NPU
encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 4.552 ms 3 - 251 MB NPU
encoder QNN_DLC w8a8 Qualcomm® SA7255P 20.164 ms 3 - 260 MB NPU
encoder QNN_DLC w8a8 Qualcomm® SA8295P 2134.257 ms 3 - 283 MB NPU
encoder QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 4.552 ms 3 - 251 MB NPU
encoder QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 3.788 ms 3 - 269 MB NPU
encoder QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 11.559 ms 3 - 264 MB NPU
encoder TFLITE float Snapdragon® 8 Gen 3 Mobile 16.621 ms 20 - 370 MB NPU
encoder TFLITE float Snapdragon® 8 Gen 1 Mobile 100.289 ms 21 - 442 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ IQ-8275 27.242 ms 0 - 47 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 23.104 ms 20 - 23 MB NPU
encoder TFLITE float Qualcomm® SA8775P 27.574 ms 20 - 285 MB NPU
encoder TFLITE float Qualcomm® SA8650P 27.574 ms 20 - 285 MB NPU
encoder TFLITE float Qualcomm® SA8255P 27.574 ms 20 - 285 MB NPU
encoder TFLITE float Qualcomm® QCS8450 100.289 ms 21 - 442 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ IQ-9075 29.087 ms 0 - 46 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ Q-8750 11.659 ms 18 - 299 MB NPU
encoder TFLITE float Qualcomm® SA7255P 68.723 ms 20 - 287 MB NPU
encoder TFLITE float Qualcomm® SA8295P 53.455 ms 20 - 365 MB NPU
encoder TFLITE float Snapdragon® 8 Elite Mobile 11.659 ms 18 - 299 MB NPU
encoder TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 8.949 ms 20 - 321 MB NPU
encoder TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 4.803 ms 5 - 302 MB NPU
encoder TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 2265.555 ms 1 - 326 MB NPU
encoder TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 4483.221 ms 4 - 28 MB NPU
encoder TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 6.883 ms 5 - 22 MB NPU
encoder TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.997 ms 5 - 7 MB NPU
encoder TFLITE w8a8 Qualcomm® SA8775P 7.819 ms 5 - 260 MB NPU
encoder TFLITE w8a8 Qualcomm® SA8650P 7.819 ms 5 - 260 MB NPU
encoder TFLITE w8a8 Qualcomm® SA8255P 7.819 ms 5 - 260 MB NPU
encoder TFLITE w8a8 Qualcomm® QCS8450 2265.555 ms 1 - 326 MB NPU
encoder TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 7.584 ms 2 - 19 MB NPU
encoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 76.213 ms 3 - 233 MB NPU
encoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 8.258 ms 5 - 261 MB NPU
encoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 2.965 ms 3 - 253 MB NPU
encoder TFLITE w8a8 Qualcomm® SA7255P 13.696 ms 5 - 260 MB NPU
encoder TFLITE w8a8 Qualcomm® SA8295P 2102.827 ms 0 - 280 MB NPU
encoder TFLITE w8a8 Snapdragon® 8 Elite Mobile 2.965 ms 3 - 253 MB NPU
encoder TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 2.64 ms 0 - 262 MB NPU
encoder TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 8.258 ms 5 - 261 MB NPU
memory_encoder ONNX float Snapdragon® X2 Elite 10.55 ms 8 - 8 MB NPU
memory_encoder ONNX float Snapdragon® X Elite 25.161 ms 8 - 8 MB NPU
memory_encoder ONNX float Snapdragon® 8 Gen 3 Mobile 19.647 ms 8 - 455 MB NPU
memory_encoder ONNX float Snapdragon® 8 Gen 1 Mobile 38.074 ms 8 - 331 MB NPU
memory_encoder ONNX float Qualcomm® Dragonwing™ IQ-8275 27.246 ms 8 - 11 MB NPU
memory_encoder ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 24.911 ms 8 - 13 MB NPU
memory_encoder ONNX float Qualcomm® QCS8450 38.074 ms 8 - 331 MB NPU
memory_encoder ONNX float Qualcomm® Dragonwing™ IQ-9075 29.631 ms 8 - 11 MB NPU
memory_encoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 25.161 ms 8 - 8 MB NPU
memory_encoder ONNX float Qualcomm® Dragonwing™ Q-8750 13.72 ms 0 - 295 MB NPU
memory_encoder ONNX float Snapdragon® 8 Elite Mobile 13.72 ms 0 - 295 MB NPU
memory_encoder ONNX float Snapdragon® 8 Elite Gen 5 Mobile 9.87 ms 2 - 294 MB NPU
memory_encoder ONNX w8a8 Snapdragon® X2 Elite 2.861 ms 2 - 2 MB NPU
memory_encoder ONNX w8a8 Snapdragon® X Elite 5.883 ms 1 - 1 MB NPU
memory_encoder ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 3.708 ms 2 - 219 MB NPU
memory_encoder ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 10.881 ms 2 - 346 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 36.939 ms 2 - 5 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 5.246 ms 2 - 6 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.625 ms 1 - 5 MB NPU
memory_encoder ONNX w8a8 Qualcomm® QCS8450 10.881 ms 2 - 346 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 6.001 ms 2 - 5 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 5.883 ms 1 - 1 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 33.702 ms 2 - 327 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 6.68 ms 2 - 283 MB NPU
memory_encoder ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 4.044 ms 2 - 300 MB NPU
memory_encoder ONNX w8a8 Snapdragon® 8 Elite Mobile 4.044 ms 2 - 300 MB NPU
memory_encoder ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 3.599 ms 0 - 298 MB NPU
memory_encoder ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 6.68 ms 2 - 283 MB NPU
memory_encoder QNN_DLC float Snapdragon® X2 Elite 10.738 ms 8 - 8 MB NPU
memory_encoder QNN_DLC float Snapdragon® X Elite 19.915 ms 8 - 8 MB NPU
memory_encoder QNN_DLC float Snapdragon® 8 Gen 3 Mobile 13.281 ms 8 - 730 MB NPU
memory_encoder QNN_DLC float Snapdragon® 8 Gen 1 Mobile 29.394 ms 4 - 405 MB NPU
memory_encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 20.182 ms 8 - 19 MB NPU
memory_encoder QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 18.79 ms 8 - 158 MB NPU
memory_encoder QNN_DLC float Qualcomm® SA8775P 20.933 ms 0 - 322 MB NPU
memory_encoder QNN_DLC float Qualcomm® SA8650P 20.933 ms 0 - 322 MB NPU
memory_encoder QNN_DLC float Qualcomm® SA8255P 20.933 ms 0 - 322 MB NPU
memory_encoder QNN_DLC float Qualcomm® QCS8450 29.394 ms 4 - 405 MB NPU
memory_encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 21.224 ms 8 - 18 MB NPU
memory_encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 19.915 ms 8 - 8 MB NPU
memory_encoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 10.768 ms 4 - 315 MB NPU
memory_encoder QNN_DLC float Qualcomm® SA7255P 44.773 ms 1 - 317 MB NPU
memory_encoder QNN_DLC float Qualcomm® SA8295P 23.55 ms 0 - 366 MB NPU
memory_encoder QNN_DLC float Snapdragon® 8 Elite Mobile 10.768 ms 4 - 315 MB NPU
memory_encoder QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 9.23 ms 4 - 314 MB NPU
memory_encoder QNN_DLC w8a8 Snapdragon® X2 Elite 3.029 ms 2 - 2 MB NPU
memory_encoder QNN_DLC w8a8 Snapdragon® X Elite 6.522 ms 2 - 2 MB NPU
memory_encoder QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 3.947 ms 0 - 235 MB NPU
memory_encoder QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 7.51 ms 0 - 198 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 36.609 ms 1 - 5 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 5.52 ms 1 - 5 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.91 ms 2 - 4 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® SA8775P 6.627 ms 2 - 168 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® SA8650P 6.627 ms 2 - 168 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® SA8255P 6.627 ms 2 - 168 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® QCS8450 7.51 ms 0 - 198 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 6.389 ms 1 - 5 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 6.522 ms 2 - 2 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 29.496 ms 2 - 383 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 7.186 ms 2 - 313 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 2.993 ms 1 - 175 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® SA7255P 10.994 ms 1 - 165 MB NPU
memory_encoder QNN_DLC w8a8 Qualcomm® SA8295P 7.758 ms 2 - 181 MB NPU
memory_encoder QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 2.993 ms 1 - 175 MB NPU
memory_encoder QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 2.505 ms 1 - 203 MB NPU
memory_encoder QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 7.186 ms 2 - 313 MB NPU
memory_encoder TFLITE float Snapdragon® 8 Gen 3 Mobile 19.494 ms 0 - 351 MB NPU
memory_encoder TFLITE float Snapdragon® 8 Gen 1 Mobile 38.468 ms 0 - 318 MB NPU
memory_encoder TFLITE float Qualcomm® Dragonwing™ IQ-8275 27.217 ms 0 - 17 MB NPU
memory_encoder TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 24.838 ms 0 - 4 MB NPU
memory_encoder TFLITE float Qualcomm® SA8775P 28.699 ms 0 - 312 MB NPU
memory_encoder TFLITE float Qualcomm® SA8650P 28.699 ms 0 - 312 MB NPU
memory_encoder TFLITE float Qualcomm® SA8255P 28.699 ms 0 - 312 MB NPU
memory_encoder TFLITE float Qualcomm® QCS8450 38.468 ms 0 - 318 MB NPU
memory_encoder TFLITE float Qualcomm® Dragonwing™ IQ-9075 29.1 ms 0 - 16 MB NPU
memory_encoder TFLITE float Qualcomm® Dragonwing™ Q-8750 15.928 ms 0 - 352 MB NPU
memory_encoder TFLITE float Qualcomm® SA7255P 53.437 ms 0 - 311 MB NPU
memory_encoder TFLITE float Qualcomm® SA8295P 33.253 ms 0 - 288 MB NPU
memory_encoder TFLITE float Snapdragon® 8 Elite Mobile 15.928 ms 0 - 352 MB NPU
memory_encoder TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 9.87 ms 0 - 311 MB NPU
memory_encoder TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 6.097 ms 0 - 256 MB NPU
memory_encoder TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 12.956 ms 1 - 250 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 104.336 ms 10 - 52 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 8.816 ms 1 - 10 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.58 ms 1 - 3 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® SA8775P 9.814 ms 1 - 228 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® SA8650P 9.814 ms 1 - 228 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® SA8255P 9.814 ms 1 - 228 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® QCS8450 12.956 ms 1 - 250 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 9.349 ms 0 - 9 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 70.435 ms 10 - 236 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 32.179 ms 10 - 196 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 4.509 ms 1 - 235 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® SA7255P 17.188 ms 1 - 227 MB NPU
memory_encoder TFLITE w8a8 Qualcomm® SA8295P 12.067 ms 1 - 230 MB NPU
memory_encoder TFLITE w8a8 Snapdragon® 8 Elite Mobile 4.509 ms 1 - 235 MB NPU
memory_encoder TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 3.91 ms 1 - 239 MB NPU
memory_encoder TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 32.179 ms 10 - 196 MB NPU
video_decoder ONNX float Snapdragon® X2 Elite 3.419 ms 16 - 16 MB NPU
video_decoder ONNX float Snapdragon® X Elite 7.028 ms 16 - 16 MB NPU
video_decoder ONNX float Snapdragon® 8 Gen 3 Mobile 5.009 ms 17 - 273 MB NPU
video_decoder ONNX float Snapdragon® 8 Gen 1 Mobile 14.43 ms 17 - 287 MB NPU
video_decoder ONNX float Qualcomm® Dragonwing™ IQ-8275 7.909 ms 16 - 19 MB NPU
video_decoder ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 7.155 ms 16 - 19 MB NPU
video_decoder ONNX float Qualcomm® QCS8450 14.43 ms 17 - 287 MB NPU
video_decoder ONNX float Qualcomm® Dragonwing™ IQ-9075 8.365 ms 16 - 19 MB NPU
video_decoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 7.028 ms 16 - 16 MB NPU
video_decoder ONNX float Qualcomm® Dragonwing™ Q-8750 3.869 ms 3 - 247 MB NPU
video_decoder ONNX float Snapdragon® 8 Elite Mobile 3.869 ms 3 - 247 MB NPU
video_decoder ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.417 ms 1 - 230 MB NPU
video_decoder ONNX w8a8 Snapdragon® X2 Elite 2.041 ms 4 - 4 MB NPU
video_decoder ONNX w8a8 Snapdragon® X Elite 3.566 ms 4 - 4 MB NPU
video_decoder ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 2.28 ms 4 - 159 MB NPU
video_decoder ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 4.327 ms 4 - 167 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 15.363 ms 5 - 8 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 3.491 ms 4 - 8 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.393 ms 2 - 8 MB NPU
video_decoder ONNX w8a8 Qualcomm® QCS8450 4.327 ms 4 - 167 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 3.965 ms 4 - 7 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 3.566 ms 4 - 4 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 19.889 ms 2 - 252 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 4.564 ms 4 - 300 MB NPU
video_decoder ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 1.84 ms 0 - 127 MB NPU
video_decoder ONNX w8a8 Snapdragon® 8 Elite Mobile 1.84 ms 0 - 127 MB NPU
video_decoder ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 1.539 ms 0 - 156 MB NPU
video_decoder ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 4.564 ms 4 - 300 MB NPU
video_decoder QNN_DLC float Snapdragon® X2 Elite 4.761 ms 16 - 16 MB NPU
video_decoder QNN_DLC float Snapdragon® X Elite 6.122 ms 16 - 16 MB NPU
video_decoder QNN_DLC float Snapdragon® 8 Gen 3 Mobile 4.096 ms 4 - 246 MB NPU
video_decoder QNN_DLC float Snapdragon® 8 Gen 1 Mobile 10.642 ms 4 - 223 MB NPU
video_decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 6.571 ms 16 - 35 MB NPU
video_decoder QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.815 ms 16 - 18 MB NPU
video_decoder QNN_DLC float Qualcomm® SA8775P 7.091 ms 16 - 233 MB NPU
video_decoder QNN_DLC float Qualcomm® SA8650P 7.091 ms 16 - 233 MB NPU
video_decoder QNN_DLC float Qualcomm® SA8255P 7.091 ms 16 - 233 MB NPU
video_decoder QNN_DLC float Qualcomm® QCS8450 10.642 ms 4 - 223 MB NPU
video_decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 6.931 ms 16 - 34 MB NPU
video_decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 6.122 ms 16 - 16 MB NPU
video_decoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 3.205 ms 4 - 219 MB NPU
video_decoder QNN_DLC float Qualcomm® SA7255P 13.385 ms 16 - 230 MB NPU
video_decoder QNN_DLC float Qualcomm® SA8295P 8.842 ms 0 - 197 MB NPU
video_decoder QNN_DLC float Snapdragon® 8 Elite Mobile 3.205 ms 4 - 219 MB NPU
video_decoder QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 2.813 ms 4 - 199 MB NPU
video_decoder QNN_DLC w8a8 Snapdragon® X2 Elite 1.649 ms 4 - 4 MB NPU
video_decoder QNN_DLC w8a8 Snapdragon® X Elite 3.173 ms 4 - 4 MB NPU
video_decoder QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 1.781 ms 0 - 112 MB NPU
video_decoder QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 3.284 ms 0 - 110 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 11.214 ms 1 - 7 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 2.815 ms 1 - 7 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 2.725 ms 4 - 6 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® SA8775P 3.369 ms 4 - 91 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® SA8650P 3.369 ms 4 - 91 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® SA8255P 3.369 ms 4 - 91 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® QCS8450 3.284 ms 0 - 110 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 3.194 ms 3 - 9 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 3.173 ms 4 - 4 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 13.585 ms 4 - 278 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 3.292 ms 4 - 215 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 1.413 ms 1 - 93 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® SA7255P 5.19 ms 4 - 90 MB NPU
video_decoder QNN_DLC w8a8 Qualcomm® SA8295P 3.856 ms 4 - 89 MB NPU
video_decoder QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 1.413 ms 1 - 93 MB NPU
video_decoder QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 1.221 ms 1 - 112 MB NPU
video_decoder QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 3.292 ms 4 - 215 MB NPU
video_decoder TFLITE float Snapdragon® 8 Gen 3 Mobile 4.101 ms 0 - 238 MB NPU
video_decoder TFLITE float Snapdragon® 8 Gen 1 Mobile 10.732 ms 0 - 224 MB NPU
video_decoder TFLITE float Qualcomm® Dragonwing™ IQ-8275 6.588 ms 0 - 32 MB NPU
video_decoder TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.862 ms 0 - 9 MB NPU
video_decoder TFLITE float Qualcomm® SA8775P 7.104 ms 0 - 194 MB NPU
video_decoder TFLITE float Qualcomm® SA8650P 7.104 ms 0 - 194 MB NPU
video_decoder TFLITE float Qualcomm® SA8255P 7.104 ms 0 - 194 MB NPU
video_decoder TFLITE float Qualcomm® QCS8450 10.732 ms 0 - 224 MB NPU
video_decoder TFLITE float Qualcomm® Dragonwing™ IQ-9075 6.868 ms 0 - 31 MB NPU
video_decoder TFLITE float Qualcomm® Dragonwing™ Q-8750 3.161 ms 0 - 187 MB NPU
video_decoder TFLITE float Qualcomm® SA7255P 13.366 ms 0 - 216 MB NPU
video_decoder TFLITE float Qualcomm® SA8295P 8.872 ms 0 - 200 MB NPU
video_decoder TFLITE float Snapdragon® 8 Elite Mobile 3.161 ms 0 - 187 MB NPU
video_decoder TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.731 ms 0 - 212 MB NPU
video_decoder TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 5.921 ms 0 - 245 MB NPU
video_decoder TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 9.998 ms 0 - 243 MB NPU
video_decoder TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 41.513 ms 12 - 58 MB NPU
video_decoder TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 8.857 ms 0 - 15 MB NPU
video_decoder TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 7.572 ms 0 - 12 MB NPU
video_decoder TFLITE w8a8 Qualcomm® SA8775P 9.772 ms 0 - 314 MB NPU
video_decoder TFLITE w8a8 Qualcomm® SA8650P 9.772 ms 0 - 314 MB NPU
video_decoder TFLITE w8a8 Qualcomm® SA8255P 9.772 ms 0 - 314 MB NPU
video_decoder TFLITE w8a8 Qualcomm® QCS8450 9.998 ms 0 - 243 MB NPU
video_decoder TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 9.444 ms 0 - 14 MB NPU
video_decoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 34.785 ms 12 - 213 MB NPU
video_decoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 15.149 ms 12 - 202 MB NPU
video_decoder TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 3.909 ms 0 - 247 MB NPU
video_decoder TFLITE w8a8 Qualcomm® SA7255P 15.37 ms 0 - 216 MB NPU
video_decoder TFLITE w8a8 Qualcomm® SA8295P 9.251 ms 0 - 221 MB NPU
video_decoder TFLITE w8a8 Snapdragon® 8 Elite Mobile 3.909 ms 0 - 247 MB NPU
video_decoder TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 3.426 ms 0 - 260 MB NPU
video_decoder TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 15.149 ms 12 - 202 MB NPU

License

  • The license for the original implementation of EdgeTAM can be found here.

References

Community