https://huggingface.co/rhymes-ai/Aria-Chat

#500
by trahloc - opened

https://huggingface.co/rhymes-ai/Aria-Chat is a multimodal model that would be cool to have a gguf version if possible.

Probably not supported by llama.cpp unless you know of a llama.cpp fork that supports it. It is AriaForConditionalGeneration and uses the AriaVisionModel architecture. llama.cpp only supports MiniCPM-V-2.5 and MiniCPM-V-2.6 based multimodular models as far I’m aware and even those require the use of a fork to do the HF to GGUF conversion.

mradermacher changed discussion status to closed

Sign up or log in to comment