OmniFusion-1.1-gguf / README.md
Ftfyhh's picture
Upload README.md
f2ab9d4 verified

Original model: https://huggingface.co/AIRI-Institute/OmniFusion/tree/main/OmniMistral-v1_1

GGUF q5. There is only the text part of LLM in this model files. Visual part (projector) is not working. It needs to be converted to gguf seperately.

Guide is here: but i didn't test it, and not sure that it will work: https://github.com/ggerganov/llama.cpp/tree/master/examples/llava#llava-15