Create README.md

README.md

@@ -0,0 +1,16 @@
+---
+base_model: "stabilityai/stablelm-2-zephyr-1_6b"
+---
+
+
+This is a quantized version of the Stable LM 2 Zephyr 1.6B model, see the
+[model card](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b)
+for a model description and license.
+
+This quantized version has been generated from the
+[model.safetensors](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b/tree/main) weights file
+using the [`Candle tensor-tools`](https://github.com/huggingface/candle/blob/main/candle-core/examples/tensor-tools.rs) application:
+
+```shell
+tensor-tools quantize --quantization q4_1 --out-file stablelm-2-zephyr-1_6b-Q4_1.gguf model.safetensors
+```