---
base_model: "stabilityai/stablelm-2-zephyr-1_6b"
---


This is a quantized version of the Stable LM 2 Zephyr 1.6B model, see the
[model card](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b)
for a model description and license.

This quantized version has been generated from the
[model.safetensors](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b/tree/main) weights file
using the [`Candle tensor-tools`](https://github.com/huggingface/candle/blob/main/candle-core/examples/tensor-tools.rs) application:

```shell
tensor-tools quantize --quantization q4_1 --out-file stablelm-2-zephyr-1_6b-Q4_1.gguf model.safetensors
```