Not able to load locally downloaded model using SentenceTransformer
#16
by
umesh-c
- opened
My simple code to load the model using locally downloaded path:
from sentence_transformers import SentenceTransformer
self.model = SentenceTransformer(self.model_path)
model_path is : models/downloads/mxbai-embed-large-v1
ll models/downloads/mxbai-embed-large-v1
total 7248200
drwxr-xr-x 3 umesh staff 96B Aug 28 15:43 1_Pooling
-rw-r--r-- 1 umesh staff 11K Aug 28 15:43 LICENSE
-rw-r--r-- 1 umesh staff 111K Aug 28 15:43 README.md
-rw-r--r-- 1 umesh staff 677B Aug 28 15:43 config.json
-rw-r--r-- 1 umesh staff 171B Aug 28 15:43 config_sentence_transformers.json
drwxr-xr-x 3 umesh staff 96B Aug 28 15:43 gguf
-rw-r--r-- 1 umesh staff 1.2G Aug 28 15:45 model.onnx
-rw-r--r-- 1 umesh staff 639M Aug 28 15:44 model.safetensors
-rw-r--r-- 1 umesh staff 638M Aug 28 15:46 model_fp16.onnx
-rw-r--r-- 1 umesh staff 321M Aug 28 15:46 model_quantized.onnx
-rw-r--r-- 1 umesh staff 229B Aug 28 15:43 modules.json
-rw-r--r-- 1 umesh staff 639M Aug 28 15:44 mxbai-embed-large-v1-f16.gguf
drwxr-xr-x 5 umesh staff 160B Aug 28 15:43 onnx
-rw-r--r-- 1 umesh staff 53B Aug 28 15:43 sentence_bert_config.json
-rw-r--r-- 1 umesh staff 695B Aug 28 15:43 special_tokens_map.json
-rw-r--r-- 1 umesh staff 695K Aug 28 15:43 tokenizer.json
-rw-r--r-- 1 umesh staff 1.2K Aug 28 15:43 tokenizer_config.json
-rw-r--r-- 1 umesh staff 226K Aug 28 15:43 vocab.txt
Lib versions are as follows :
Python 3.11.9
sentence-transformers 3.0.1
torch 2.4.0
The error which I am getting with below thread dump:
Fatal Python error: Aborted
Current thread 0x00000001f59e2500 (most recent call first):
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1160 in convert
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/torch/nn/modules/module.py", line 805 in _apply
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/torch/nn/modules/module.py", line 780 in _apply
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/torch/nn/modules/module.py", line 780 in _apply
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/torch/nn/modules/module.py", line 780 in _apply
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/torch/nn/modules/module.py", line 780 in _apply
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1174 in to
File "/Users/umesh/git-repos/genai_search/cxg/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 316 in __init__
File "/Users/umesh/git-repos/genai_search/models/impl/mxbai_embed_large_v1.py", line 13 in __init__
Clueless what might be wrong as I am doing same as mentioned in the README. Can someone point the possible issue?
BTW, I am able to load the bge-large-en-v1.5
model just fine using SentenceTransformer.
Thanks!