ikawrakow
/

various-2bit-sota-gguf

Inference Endpoints

Model card Files Files and versions Community

ikawrakow commited on Jan 5

Commit

5c2dcb5

•

1 Parent(s): 7790dee

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -1,3 +1,4 @@
 ---
 license: apache-2.0
 ---

 ---
 license: apache-2.0
 ---
+Various models in GGUF format quantized with a new 2-bit approach. Intended for use with llama.cpp. Requires llama.cpp PR 4773.