dranger003
/

bagel-34b-v0.4-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Feb 17

Commit

c63066a

•

1 Parent(s): d0f2a83

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -9,6 +9,7 @@ GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bag
 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
 Context length: 200K
 Prompt template: Llama-2 chat (recommended)
 ```
 [INST] <<SYS>>

 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
 Context length: 200K
+Prompt strategies: https://huggingface.co/jondurbin/bagel-34b-v0.4#prompting-strategies
 Prompt template: Llama-2 chat (recommended)
 ```
 [INST] <<SYS>>