Update README.md
Browse files
README.md
CHANGED
@@ -12,9 +12,15 @@ tags:
|
|
12 |
|
13 |
# stablelm-tuned-alpha-3b-gptq-4bit-128g
|
14 |
|
15 |
-
This is a quantized model saved with [auto-gptq](https://github.com/PanQiWei/AutoGPTQ). At time of writing, you cannot directly load models from the hub, but will need to clone
|
16 |
|
17 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
---
|
20 |
|
|
|
12 |
|
13 |
# stablelm-tuned-alpha-3b-gptq-4bit-128g
|
14 |
|
15 |
+
This is a quantized model saved with [auto-gptq](https://github.com/PanQiWei/AutoGPTQ). At time of writing, you cannot directly load models from the hub, but will need to clone this repo and load locally.
|
16 |
|
17 |
+
|
18 |
+
```bash
|
19 |
+
git lfs install
|
20 |
+
git clone https://huggingface.co/ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g
|
21 |
+
```
|
22 |
+
|
23 |
+
See the below [excerpt from the tutorial](https://github.com/PanQiWei/AutoGPTQ/blob/main/docs/tutorial/01-Quick-Start.md) for instructions.
|
24 |
|
25 |
---
|
26 |
|