Just testing some imatrix stuff. Built using Imatrix_imatrix-with-rp-data.txt done at 4K context (seems best ppl with Nemo fts.)

May randomly disappear at a future date.

Downloads last month
66
GGUF
Model size
12.2B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

5-bit

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support