Update README.md
Browse files
README.md
CHANGED
@@ -7,8 +7,18 @@ This repository contains the most relevant quantizations of Stability AI's
|
|
7 |
in GGUF format - ready to be used with
|
8 |
[llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
|
9 |
|
10 |
-
|
11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
of the original model.
|
13 |
|
14 |
(more details will follow a.s.a.p.)
|
|
|
7 |
in GGUF format - ready to be used with
|
8 |
[llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
|
9 |
|
10 |
+
Right now, the following quantizations are available:
|
11 |
+
|
12 |
+
* [stablelm-3b-4e1t-Q4_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q4_K_M.bin)
|
13 |
+
* [stablelm-3b-4e1t-Q5_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q5_K_M.bin)
|
14 |
+
* [stablelm-3b-4e1t-Q6_K](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q6_K.bin)
|
15 |
+
* [stablelm-3b-4e1t-Q8_K](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q8_K.bin)
|
16 |
+
|
17 |
+
These files are presented here with the written permission of Stability AI (although
|
18 |
+
access to the model itself is "gated").
|
19 |
+
|
20 |
+
|
21 |
+
The chosen license is the same as that
|
22 |
of the original model.
|
23 |
|
24 |
(more details will follow a.s.a.p.)
|