v0.32.0
Browse filesSee https://github.com/quic/ai-hub-models/releases/v0.32.0 for changelog.
- .gitattributes +1 -0
- DEPLOYMENT_MODEL_LICENSE.pdf +3 -0
- LICENSE +2 -0
- OpenAI-Clip.onnx +2 -2
- README.md +6 -8
.gitattributes
CHANGED
@@ -37,3 +37,4 @@ CLIPTextEncoder.so filter=lfs diff=lfs merge=lfs -text
|
|
37 |
CLIPImageEncoder.so filter=lfs diff=lfs merge=lfs -text
|
38 |
OpenAI-Clip.so filter=lfs diff=lfs merge=lfs -text
|
39 |
OpenAI-Clip.dlc filter=lfs diff=lfs merge=lfs -text
|
|
|
|
37 |
CLIPImageEncoder.so filter=lfs diff=lfs merge=lfs -text
|
38 |
OpenAI-Clip.so filter=lfs diff=lfs merge=lfs -text
|
39 |
OpenAI-Clip.dlc filter=lfs diff=lfs merge=lfs -text
|
40 |
+
DEPLOYMENT_MODEL_LICENSE.pdf filter=lfs diff=lfs merge=lfs -text
|
DEPLOYMENT_MODEL_LICENSE.pdf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4409f93b0e82531303b3e10f52f1fdfb56467a25f05b7441c6bbd8bb8a64b42c
|
3 |
+
size 109629
|
LICENSE
ADDED
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
1 |
+
The license of the original trained model can be found at https://github.com/openai/CLIP/blob/main/LICENSE.
|
2 |
+
The license for the deployable model files (.tflite, .onnx, .dlc, .bin, etc.) can be found in DEPLOYMENT_MODEL_LICENSE.pdf.
|
OpenAI-Clip.onnx
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:17b702f6c2bbfcc19faf69cab19aad08e5eef7105ab22a29d10a73ede89f5cc7
|
3 |
+
size 598804093
|
README.md
CHANGED
@@ -31,10 +31,8 @@ More details on model performance across various devices, can be found
|
|
31 |
- Model checkpoint: ViT-B/16
|
32 |
- Image input resolution: 224x224
|
33 |
- Text context length: 77
|
34 |
-
- Number of parameters
|
35 |
-
- Model size (
|
36 |
-
- Number of parameters (CLIPImageEncoder): 115M
|
37 |
-
- Model size (CLIPImageEncoder): 437 MB
|
38 |
|
39 |
| Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
|
40 |
|---|---|---|---|---|---|---|---|---|
|
@@ -58,15 +56,15 @@ More details on model performance across various devices, can be found
|
|
58 |
| OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 22.704 ms | 0 - 484 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
59 |
| OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 23.566 ms | 0 - 29 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
|
60 |
| OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 19.911 ms | 0 - 57 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
61 |
-
| OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 24.
|
62 |
| OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 16.784 ms | 0 - 415 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
|
63 |
| OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 14.146 ms | 1 - 491 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
64 |
-
| OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 17.
|
65 |
| OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 13.737 ms | 0 - 406 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
|
66 |
| OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 13.268 ms | 1 - 470 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
67 |
-
| OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX |
|
68 |
| OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 21.759 ms | 1667 - 1667 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
69 |
-
| OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 25.
|
70 |
|
71 |
|
72 |
|
|
|
31 |
- Model checkpoint: ViT-B/16
|
32 |
- Image input resolution: 224x224
|
33 |
- Text context length: 77
|
34 |
+
- Number of parameters: 150M
|
35 |
+
- Model size (float): 571 MB
|
|
|
|
|
36 |
|
37 |
| Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
|
38 |
|---|---|---|---|---|---|---|---|---|
|
|
|
56 |
| OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 22.704 ms | 0 - 484 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
57 |
| OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 23.566 ms | 0 - 29 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
|
58 |
| OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 19.911 ms | 0 - 57 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
59 |
+
| OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 24.694 ms | 0 - 132 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
|
60 |
| OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 16.784 ms | 0 - 415 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
|
61 |
| OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 14.146 ms | 1 - 491 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
62 |
+
| OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 17.628 ms | 1 - 531 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
|
63 |
| OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 13.737 ms | 0 - 406 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
|
64 |
| OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 13.268 ms | 1 - 470 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
65 |
+
| OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 16.816 ms | 1 - 513 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
|
66 |
| OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 21.759 ms | 1667 - 1667 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
|
67 |
+
| OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 25.714 ms | 293 - 293 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
|
68 |
|
69 |
|
70 |
|