Hugging Face's logo

qualcomm
/
ResNet-Mixed-Convolution

Video Classification
PyTorch
backbone
android
Model card Files
xet
 Community
1

ResNet-Mixed-Convolution: Optimized for Qualcomm Devices

ResNet Mixed Convolutions is a network with a mixture of 2D and 3D convolutions used for video understanding.

This is based on the implementation of ResNet-Mixed-Convolution found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
ONNX w8a16 Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
ONNX w8a8 Universal QAIRT 2.45, ONNX Runtime 1.27.1 Download
QNN_DLC float Universal QAIRT 2.45 Download
QNN_DLC w8a16 Universal QAIRT 2.45 Download
QNN_DLC w8a8 Universal QAIRT 2.45 Download
TFLITE float Universal QAIRT 2.45 Download
TFLITE w8a8 Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit ResNet-Mixed-Convolution on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for ResNet-Mixed-Convolution on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.video_classification

Model Stats:

  • Input resolution: 112x112
  • Model checkpoint: Kinetics-400
  • Model size (float): 44.6 MB
  • Model size (w8a16): 11.5 MB
  • Number of parameters: 11.7M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
ResNet-Mixed-Convolution ONNX float Snapdragon® X2 Elite 37.668 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® X Elite 70.049 ms 18 - 18 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Gen 3 Mobile 50.368 ms 12 - 725 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Gen 1 Mobile 134.063 ms 13 - 520 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ IQ-8275 141.873 ms 11 - 15 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 70.987 ms 0 - 18 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® QCS8450 134.063 ms 13 - 520 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ IQ-9075 127.314 ms 11 - 14 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ IQ-X7181 70.049 ms 18 - 18 MB NPU
ResNet-Mixed-Convolution ONNX float Qualcomm® Dragonwing™ Q-8750 42.461 ms 1 - 542 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Elite Mobile 42.461 ms 1 - 542 MB NPU
ResNet-Mixed-Convolution ONNX float Snapdragon® 8 Elite Gen 5 Mobile 31.232 ms 4 - 566 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® X2 Elite 24.829 ms 7 - 7 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® X Elite 45.125 ms 11 - 11 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 33.093 ms 6 - 585 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 79.002 ms 6 - 582 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 48.053 ms 6 - 9 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 43.989 ms 0 - 13 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® QCS8450 79.002 ms 6 - 582 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 41.756 ms 6 - 9 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 45.125 ms 11 - 11 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 26.471 ms 0 - 380 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Elite Mobile 26.471 ms 0 - 380 MB NPU
ResNet-Mixed-Convolution ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 19.771 ms 1 - 411 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® X2 Elite 11.603 ms 3 - 3 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® X Elite 24.45 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 16.874 ms 3 - 443 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 35.422 ms 3 - 441 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 24.689 ms 3 - 6 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 23.479 ms 0 - 17 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® QCS8450 35.422 ms 3 - 441 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 22.378 ms 3 - 6 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 24.45 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 42.238 ms 3 - 358 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 14.241 ms 0 - 338 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Elite Mobile 14.241 ms 0 - 338 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 9.36 ms 0 - 345 MB NPU
ResNet-Mixed-Convolution ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 42.238 ms 3 - 358 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® X2 Elite 38.117 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® X Elite 70.847 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Gen 3 Mobile 50.71 ms 12 - 717 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Gen 1 Mobile 132.795 ms 4 - 513 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 142.554 ms 12 - 25 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 494.195 ms 0 - 519 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 70.314 ms 12 - 27 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® SA8775P 126.718 ms 0 - 519 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® SA8650P 126.718 ms 0 - 519 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® SA8255P 126.718 ms 0 - 519 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® QCS8450 132.795 ms 4 - 513 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 127.36 ms 12 - 25 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 70.847 ms 12 - 12 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® Dragonwing™ Q-8750 41.737 ms 12 - 533 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® SA7255P 494.195 ms 0 - 519 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Qualcomm® SA8295P 137.641 ms 0 - 355 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Elite Mobile 41.737 ms 12 - 533 MB NPU
ResNet-Mixed-Convolution QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 31.136 ms 2 - 557 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® X2 Elite 26.101 ms 6 - 6 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® X Elite 52.103 ms 6 - 6 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 38.98 ms 6 - 718 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 74.995 ms 5 - 725 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 310.746 ms 3 - 11 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 54.387 ms 4 - 12 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 159.599 ms 6 - 468 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 50.94 ms 6 - 8 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8775P 46.689 ms 6 - 409 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8650P 46.689 ms 6 - 409 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8255P 46.689 ms 6 - 409 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® QCS8450 74.995 ms 5 - 725 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 47.481 ms 1 - 8 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 52.103 ms 6 - 6 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 1112.156 ms 6 - 513 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 89.397 ms 6 - 470 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 30.008 ms 6 - 397 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA7255P 159.599 ms 6 - 468 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Qualcomm® SA8295P 77.63 ms 0 - 407 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 30.008 ms 6 - 397 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 21.658 ms 6 - 437 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 89.397 ms 6 - 470 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® X2 Elite 12.431 ms 3 - 3 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® X Elite 26.234 ms 3 - 3 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 18.133 ms 3 - 441 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 34.756 ms 3 - 438 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 113.304 ms 5 - 9 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 26.113 ms 1 - 6 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 82.782 ms 3 - 338 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 25.07 ms 3 - 7 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® SA8775P 23.423 ms 3 - 338 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® SA8650P 23.423 ms 3 - 338 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® SA8255P 23.423 ms 3 - 338 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® QCS8450 34.756 ms 3 - 438 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 23.796 ms 3 - 8 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 26.234 ms 3 - 3 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 496.594 ms 3 - 397 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 43.526 ms 3 - 351 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 15.133 ms 3 - 337 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® SA7255P 82.782 ms 3 - 338 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Qualcomm® SA8295P 42.986 ms 0 - 335 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 15.133 ms 3 - 337 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 10.345 ms 3 - 349 MB NPU
ResNet-Mixed-Convolution QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 43.526 ms 3 - 351 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Gen 3 Mobile 1243.987 ms 0 - 831 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Gen 1 Mobile 1826.803 ms 1 - 662 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ IQ-8275 1522.266 ms 0 - 44 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ IQ-8275 2984.552 ms 1 - 652 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 1587.777 ms 0 - 4 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8775P 1564.079 ms 0 - 652 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8650P 1564.079 ms 0 - 652 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8255P 1564.079 ms 0 - 652 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® QCS8450 1826.803 ms 1 - 662 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ IQ-9075 1548.37 ms 0 - 43 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® Dragonwing™ Q-8750 1067.344 ms 0 - 648 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA7255P 2984.552 ms 1 - 652 MB NPU
ResNet-Mixed-Convolution TFLITE float Qualcomm® SA8295P 1819.171 ms 0 - 504 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Elite Mobile 1067.344 ms 0 - 648 MB NPU
ResNet-Mixed-Convolution TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 963.401 ms 0 - 657 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 2598.456 ms 1 - 1357 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 3747.004 ms 1 - 1083 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 16989.693 ms 3461 - 5278 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 3229.726 ms 0 - 39 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 6801.148 ms 3 - 1158 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 3094.322 ms 0 - 4 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8775P 3422.262 ms 2 - 1124 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8650P 3422.262 ms 2 - 1124 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8255P 3422.262 ms 2 - 1124 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® QCS8450 3747.004 ms 1 - 1083 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 5616.803 ms 0 - 38 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 395254.754 ms 903 - 1131 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 357958.645 ms 792 - 1124 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 2163.155 ms 1 - 822 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA7255P 6801.148 ms 3 - 1158 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Qualcomm® SA8295P 3745.277 ms 2 - 906 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Elite Mobile 2163.155 ms 1 - 822 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 2819.771 ms 0 - 1316 MB NPU
ResNet-Mixed-Convolution TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 357958.645 ms 792 - 1124 MB NPU

License

  • The license for the original implementation of ResNet-Mixed-Convolution can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Video Classification
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/ResNet-Mixed-Convolution