HugginFace text-embeddings-inference (TEI) support
#26
by
leversberg
- opened
I would love to try this model using TEI deployment.
However, currently the model is not supported.
- model_type is missing in the config.json
- text-embeddings-inference only supports fast tokenizers
I'm not very sure, but perhaps this is useful: https://huggingface.co/mixedbread-ai/mxbai-rerank-large-v1/discussions/7#66e1b400b34af35afe3a52b4
cc
@nbroad
- Tom Aarsen
This architecture is not supported for reranking in TEI since it has custom modeling code
Thanks for clarifying!