Hugging Face's logo

v000000
/
Manticore-13b-Chat-Pyg-Guanaco-GGUFs

GGUF
manticore
llama-cpp
llama
Inference Endpoints
Model card Files Community
v000000 commited on
Commit
807b973
•
1 Parent(s): a90e3a9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -13,6 +13,7 @@ tags:
13
  This model was converted to GGUF format from [`Monero/Manticore-13b-Chat-Pyg-Guanaco`](https://huggingface.co/Monero/Manticore-13b-Chat-Pyg-Guanaco) using llama.cpp
14
  Refer to the [original model card](https://huggingface.co/Monero/Manticore-13b-Chat-Pyg-Guanaco) for more details on the model.
15
 
16
- * Q5_K_M, Q6_K, Q8_0
 
17
 
18
  Manticore-13b-Chat-Pyg with the Guanaco 13b qLoRa from TimDettmers applied
 
13
  This model was converted to GGUF format from [`Monero/Manticore-13b-Chat-Pyg-Guanaco`](https://huggingface.co/Monero/Manticore-13b-Chat-Pyg-Guanaco) using llama.cpp
14
  Refer to the [original model card](https://huggingface.co/Monero/Manticore-13b-Chat-Pyg-Guanaco) for more details on the model.
15
 
16
+ * [Quants in repo:] static Q5_K_M, static Q6_K, static Q8_0, extra: groups_merged-imatrix.dat
17
+
18
 
19
  Manticore-13b-Chat-Pyg with the Guanaco 13b qLoRa from TimDettmers applied