dranger003's picture
Update README.md
e3be4c7 verified
metadata
license: apache-2.0
pipeline_tag: text-generation
library_name: gguf
base_model: ibm/labradorite-13b

NOTE: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).

GGUF importance matrix (imatrix) quants for https://huggingface.co/ibm/labradorite-13b

Layers Context Template
40
4096
<|system|>
{sys_prompt}
<|user|>
{inputs}
<|assistant|>
{response}<|endoftext|>