Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Original model: https://huggingface.co/AIRI-Institute/OmniFusion/tree/main/OmniMistral-v1_1

GGUF q5. There is only the text part of LLM in this model files. Visual part (projector) is not working. It needs to be converted to gguf seperately.

Guide is here: but i didn't test it, and not sure that it will work: https://github.com/ggerganov/llama.cpp/tree/master/examples/llava#llava-15

Downloads last month
15
GGUF
Model size
7.24B params
Architecture
llama

5-bit

Inference API
Unable to determine this model's library. Check the docs .