Yolo-v7: Optimized for Qualcomm Devices

YoloV7 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of Yolo-v7 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for Yolo-v7 on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YoloV7 Tiny
  • Input resolution: 640x640
  • Number of parameters: 6.24M
  • Model size (float): 23.8 MB
  • Model size (w8a8): 6.23 MB
  • Model size (w8a16): 6.66 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
Yolo-v7 ONNX float Snapdragon® 8 Elite Gen 5 Mobile 4.229 ms 6 - 181 MB NPU
Yolo-v7 ONNX float Snapdragon® X2 Elite 4.062 ms 8 - 8 MB NPU
Yolo-v7 ONNX float Snapdragon® X Elite 11.626 ms 8 - 8 MB NPU
Yolo-v7 ONNX float Snapdragon® 8 Gen 3 Mobile 8.291 ms 6 - 192 MB NPU
Yolo-v7 ONNX float Qualcomm® QCS8550 (Proxy) 11.507 ms 0 - 11 MB NPU
Yolo-v7 ONNX float Qualcomm® QCS9075 11.231 ms 5 - 7 MB NPU
Yolo-v7 ONNX float Snapdragon® 8 Elite For Galaxy Mobile 5.038 ms 1 - 168 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 2.035 ms 0 - 282 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® X2 Elite 2.296 ms 5 - 5 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® X Elite 5.481 ms 4 - 4 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 3.342 ms 0 - 312 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® QCS6490 426.148 ms 84 - 87 MB CPU
Yolo-v7 ONNX w8a16 Qualcomm® QCS8550 (Proxy) 4.993 ms 0 - 7 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® QCS9075 6.502 ms 2 - 5 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® QCM6690 216.01 ms 83 - 92 MB CPU
Yolo-v7 ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 2.499 ms 1 - 282 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 195.443 ms 99 - 108 MB CPU
Yolo-v7 ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 1.009 ms 0 - 68 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® X2 Elite 1.122 ms 5 - 5 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® X Elite 2.767 ms 5 - 5 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 1.623 ms 0 - 87 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® QCS6490 75.755 ms 40 - 47 MB CPU
Yolo-v7 ONNX w8a8 Qualcomm® QCS8550 (Proxy) 2.457 ms 0 - 9 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® QCS9075 3.137 ms 1 - 4 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® QCM6690 55.673 ms 40 - 49 MB CPU
Yolo-v7 ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 1.243 ms 0 - 71 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 47.146 ms 46 - 56 MB CPU
Yolo-v7 QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 3.827 ms 5 - 165 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® X2 Elite 3.973 ms 5 - 5 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® X Elite 7.557 ms 5 - 5 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® 8 Gen 3 Mobile 5.473 ms 5 - 180 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® QCS8275 (Proxy) 19.832 ms 0 - 153 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® QCS8550 (Proxy) 7.358 ms 5 - 6 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA8775P 35.944 ms 1 - 154 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® QCS9075 9.166 ms 7 - 13 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® QCS8450 (Proxy) 11.385 ms 5 - 183 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA7255P 19.832 ms 0 - 153 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA8295P 10.443 ms 0 - 151 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 4.347 ms 0 - 155 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 1.744 ms 2 - 279 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® X2 Elite 2.347 ms 2 - 2 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® X Elite 4.477 ms 2 - 2 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 2.876 ms 2 - 299 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® QCS6490 11.198 ms 1 - 5 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® QCS8275 (Proxy) 9.406 ms 1 - 274 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 4.083 ms 2 - 4 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA8775P 20.051 ms 0 - 268 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® QCS9075 5.005 ms 1 - 5 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® QCM6690 32.654 ms 2 - 228 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 7.121 ms 2 - 309 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA7255P 9.406 ms 1 - 274 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA8295P 5.925 ms 0 - 274 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 2.142 ms 2 - 275 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 5.075 ms 2 - 221 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.853 ms 1 - 55 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® X2 Elite 1.147 ms 1 - 1 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® X Elite 2.406 ms 1 - 1 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 1.428 ms 0 - 71 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® QCS6490 6.284 ms 1 - 4 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 4.746 ms 1 - 52 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 2.156 ms 1 - 3 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA8775P 2.714 ms 1 - 54 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® QCS9075 2.5 ms 3 - 5 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® QCM6690 14.03 ms 1 - 169 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 2.855 ms 1 - 72 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA7255P 4.746 ms 1 - 52 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA8295P 3.517 ms 0 - 50 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 1.105 ms 1 - 51 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 2.709 ms 1 - 263 MB NPU
Yolo-v7 TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 3.814 ms 0 - 167 MB NPU
Yolo-v7 TFLITE float Snapdragon® 8 Gen 3 Mobile 5.512 ms 1 - 190 MB NPU
Yolo-v7 TFLITE float Qualcomm® QCS8275 (Proxy) 20.235 ms 1 - 157 MB NPU
Yolo-v7 TFLITE float Qualcomm® QCS8550 (Proxy) 7.535 ms 1 - 3 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA8775P 9.185 ms 1 - 160 MB NPU
Yolo-v7 TFLITE float Qualcomm® QCS9075 9.253 ms 1 - 20 MB NPU
Yolo-v7 TFLITE float Qualcomm® QCS8450 (Proxy) 11.342 ms 0 - 189 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA7255P 20.235 ms 1 - 157 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA8295P 10.469 ms 1 - 159 MB NPU
Yolo-v7 TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 4.332 ms 1 - 165 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 1.032 ms 0 - 82 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 1.41 ms 0 - 65 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® QCS6490 6.179 ms 0 - 9 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 4.671 ms 0 - 46 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 2.184 ms 0 - 3 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA8775P 11.047 ms 0 - 56 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® QCS9075 2.482 ms 0 - 9 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® QCM6690 14.894 ms 0 - 160 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 3.086 ms 0 - 64 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA7255P 4.671 ms 0 - 46 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA8295P 3.667 ms 0 - 43 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 1.234 ms 0 - 69 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 2.751 ms 0 - 174 MB NPU

License

  • The license for the original implementation of Yolo-v7 can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/Yolo-v7