--- library_name: gguf pipeline_tag: text-generation license: apache-2.0 --- GGUF importance matrix (imatrix) quants for https://huggingface.co/abacusai/Smaug-34B-v0.1 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw. | Layers | Context | Template | | --- | --- | --- | |
60
|
200000
|
[INST] \<\\>
{instructions}
\<\
\>

{prompt} [/INST]
{response}
|