File size: 647 Bytes
336f484 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
base_model: "stabilityai/stablelm-2-zephyr-1_6b"
---
This is a quantized version of the Stable LM 2 Zephyr 1.6B model, see the
[model card](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b)
for a model description and license.
This quantized version has been generated from the
[model.safetensors](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b/tree/main) weights file
using the [`Candle tensor-tools`](https://github.com/huggingface/candle/blob/main/candle-core/examples/tensor-tools.rs) application:
```shell
tensor-tools quantize --quantization q4_1 --out-file stablelm-2-zephyr-1_6b-Q4_1.gguf model.safetensors
```
|