How to import only the layers relevant for creating embeddings?

#254
by Shashwat-AI-wiz - opened

I am using Google Colab to build a RAG system using Llamaindex. I intend to use the Mixtral model as a text embedding model. However, when I am loading the model in my notebook, it fills up the entire storage available to me. Hence, I want to extract only the layers that can be used for creating text embedding vectors. Can anyone help me with this?

Sign up or log in to comment