|
--- |
|
license: mit |
|
--- |
|
|
|
Converted [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3) model (dense retriever only) in onnx int8 format for use with [Vespa Embedding](https://docs.vespa.ai/en/embedding.html). |
|
|
|
- BAAI-bge-m3_quantized.onnx (int8 quantized) |
|
|
|
The model was quantized using the [optimum](https://github.com/huggingface/optimum) toolkit. |
|
|
|
## Tips: conver to int8 quantized |
|
``` |
|
# https://github.com/vespa-engine/sample-apps/blob/master/simple-semantic-search/export_hf_model_from_hf.py |
|
./export_hf_model_from_hf.py --hf_model BAAI/bge-m3 --output_dir bge-m3 |
|
``` |
|
|
|
``` |
|
optimum-cli onnxruntime quantize --onnx_model ./bge-m3 -o bge-m3-large_quantized --avx512_vnni |
|
``` |
|
|
|
## License |
|
The license for this model is based on the original license (found in the LICENSE file in the project's root directory), which is the MIT License. |
|
- https://huggingface.co/BAAI/bge-m3 |
|
|
|
## Attribution |
|
All credits for this model go to the authors of BAAI/bge-m3 and the associated researchers and organizations. When using this model, please be sure to attribute the original authors. |
|
|
