tiiuae

/

Falcon3-10B-Instruct-GGUF

like 15

Follow

Technology Innovation Institute 1.08k

HI @Green4el
There is an ongoing PR to add the support of Falcon3 models in llama.cpp: https://github.com/ggerganov/llama.cpp/pull/10864 once that gets merged you will be able to use it with LMStudio

It got merged but then they rolled it back because of compatibility issues :(

https://github.com/arthw/llama.cpp/commit/5b74740c83cb0a1130862b49605172702002e01b