How to change the embedding dimision?

#19
by storm2008 - opened

The output dimission is 1536. But it is too large for my application. How to reduce the output dimission?

An option for very few models is to use https://huggingface.co/blog/matryoshka if they are trained with matryoshka loss. This model was not trained with matryoshka loss, so you can't!

Sign up or log in to comment