Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model: "stabilityai/stablelm-2-zephyr-1_6b"
|
3 |
+
---
|
4 |
+
|
5 |
+
|
6 |
+
This is a quantized version of the Stable LM 2 Zephyr 1.6B model, see the
|
7 |
+
[model card](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b)
|
8 |
+
for a model description and license.
|
9 |
+
|
10 |
+
This quantized version has been generated from the
|
11 |
+
[model.safetensors](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b/tree/main) weights file
|
12 |
+
using the [`Candle tensor-tools`](https://github.com/huggingface/candle/blob/main/candle-core/examples/tensor-tools.rs) application:
|
13 |
+
|
14 |
+
```shell
|
15 |
+
tensor-tools quantize --quantization q4_1 --out-file stablelm-2-zephyr-1_6b-Q4_1.gguf model.safetensors
|
16 |
+
```
|