dranger003's picture
Update README.md
c547265 verified
|
raw
history blame
911 Bytes
metadata
license: apache-2.0
pipeline_tag: text-generation
library_name: gguf
base_model: ibm/labradorite-13b

NOTE: You will need a recent build of llama.cpp to run these quants (i.e. at least commit 494c870).

GGUF importance matrix (imatrix) quants for https://huggingface.co/ibm/labradorite-13b

Layers Context Template
40
32768
<|system|>
{sys_prompt}
<|user|>
{inputs}
<|assistant|>
{response}<|endoftext|>