dranger003 commited on
Commit
1624cbb
·
verified ·
1 Parent(s): 927ffa4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -2,4 +2,13 @@
2
  license: other
3
  license_name: yi-license
4
  license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
 
 
 
5
  ---
 
 
 
 
 
 
 
2
  license: other
3
  license_name: yi-license
4
  license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
5
+ library_name: gguf
6
+ pipeline_tag: text-generation
7
+ base_model: jondurbin/bagel-dpo-34b-v0.5
8
  ---
9
+ GGUF importance matrix (imatrix) quants for https://huggingface.co/jondurbin/bagel-dpo-34b-v0.5
10
+ The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
11
+
12
+ | Layers | Context | [Template](https://huggingface.co/jondurbin/bagel-dpo-34b-v0.5#prompt-formatting) |
13
+ | --- | --- | --- |
14
+ | <pre>60</pre> | <pre>200000</pre> | <pre>[INST] \<\<SYS\>\><br>{instructions}<br>\<\</SYS\>\><br><br>{prompt} [/INST]<br>{response}</pre> |