zatochu
/

llama-13b-pretrained-dropout-ggml-q4_0

Model card Files Files and versions Community

verymuchawful commited on Apr 13, 2023

Commit

b5538b0

•

1 Parent(s): 7a85386

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -1,4 +1,5 @@
 ---
 inference: false
 ---
-Original model: https://huggingface.co/dvruette/llama-13b-pretrained-dropout

 ---
 inference: false
 ---
+Original model: https://huggingface.co/dvruette/llama-13b-pretrained-dropout
+4/13/23: Added new q4_0 quantization using https://github.com/ggerganov/llama.cpp/pull/896. (Edited to write the model with ftype 2 so it won't be incorrectly identified as 4 - mostly q4_1 some f16.)