dranger003
/

bagel-34b-v0.4-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Feb 22

Commit

cb587b3

•

1 Parent(s): d8e74bb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ pipeline_tag: text-generation
 library_name: gguf
 ---
 GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4
-The importance matrix was trained for 50K tokens (105 batches of 512 tokens) using a [general purpose imatrix calibration dataset](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384).
 Prompt strategies: https://huggingface.co/jondurbin/bagel-34b-v0.4#prompting-strategies

 library_name: gguf
 ---
 GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-34b-v0.4
+The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) using a [general purpose imatrix calibration dataset](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384).
 Prompt strategies: https://huggingface.co/jondurbin/bagel-34b-v0.4#prompting-strategies