Update README.md
Browse files
README.md
CHANGED
@@ -2,12 +2,21 @@
|
|
2 |
license: cc-by-sa-4.0
|
3 |
---
|
4 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
This repository contains the most relevant quantizations of Stability AI's
|
6 |
[StableLM-3B-4E1T](https://huggingface.co/stabilityai/stablelm-3b-4e1t) model
|
7 |
in GGUF format - ready to be used with
|
8 |
[llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
|
9 |
|
10 |
-
|
|
|
|
|
11 |
state-of-the-art performance (September 2023) at the 3B parameter scale
|
12 |
for open-source models and is competitive with many of the popular
|
13 |
contemporary 7B models, even outperforming our most recent 7B
|
@@ -17,6 +26,8 @@ According to them "_The model is intended to be used as a foundational base
|
|
17 |
model for application-specific fine-tuning. Developers must evaluate and
|
18 |
fine-tune the model for safe performance in downstream applications._"
|
19 |
|
|
|
|
|
20 |
Right now, the following quantizations are available:
|
21 |
|
22 |
* [stablelm-3b-4e1t-Q4_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q4_K_M.bin)
|
@@ -29,6 +40,8 @@ Right now, the following quantizations are available:
|
|
29 |
These files are presented here with the written permission of Stability AI (although
|
30 |
access to the model itself is still "gated").
|
31 |
|
|
|
|
|
32 |
Any technical details can be found on the
|
33 |
[original model card](https://huggingface.co/stabilityai/stablelm-3b-4e1t) and in
|
34 |
a paper on [StableLM-3B-4E1T](https://stability.wandb.io/stability-llm/stable-lm/reports/StableLM-3B-4E1T--VmlldzoyMjU4?accessToken=u3zujipenkx5g7rtcj9qojjgxpconyjktjkli2po09nffrffdhhchq045vp0wyfo).
|
@@ -38,7 +51,9 @@ The most important ones for using this model are
|
|
38 |
* there does not seem to be a specific prompt structure - just provide the text
|
39 |
you want to be completed
|
40 |
|
41 |
-
|
|
|
|
|
42 |
([CC BY-SA-4.0](https://creativecommons.org/licenses/by-sa/4.0/)). Under this
|
43 |
license, you must give [credit](https://creativecommons.org/licenses/by/4.0/#)
|
44 |
to Stability AI, provide a link to the license, and
|
|
|
2 |
license: cc-by-sa-4.0
|
3 |
---
|
4 |
|
5 |
+
# StableLM-3B-4E1T #
|
6 |
+
|
7 |
+
* Model Creator: [Stability AI](https://huggingface.co/stabilityai)
|
8 |
+
* original Model: [StableLM-3B-4E1T](https://huggingface.co/stabilityai/stablelm-3b-4e1t)
|
9 |
+
|
10 |
+
## Description ##
|
11 |
+
|
12 |
This repository contains the most relevant quantizations of Stability AI's
|
13 |
[StableLM-3B-4E1T](https://huggingface.co/stabilityai/stablelm-3b-4e1t) model
|
14 |
in GGUF format - ready to be used with
|
15 |
[llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
|
16 |
|
17 |
+
## About StableLM-3B-4E1T ##
|
18 |
+
|
19 |
+
Stability AI claims: "_StableLM-3B-4E1T achieves
|
20 |
state-of-the-art performance (September 2023) at the 3B parameter scale
|
21 |
for open-source models and is competitive with many of the popular
|
22 |
contemporary 7B models, even outperforming our most recent 7B
|
|
|
26 |
model for application-specific fine-tuning. Developers must evaluate and
|
27 |
fine-tune the model for safe performance in downstream applications._"
|
28 |
|
29 |
+
## Files ##
|
30 |
+
|
31 |
Right now, the following quantizations are available:
|
32 |
|
33 |
* [stablelm-3b-4e1t-Q4_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q4_K_M.bin)
|
|
|
40 |
These files are presented here with the written permission of Stability AI (although
|
41 |
access to the model itself is still "gated").
|
42 |
|
43 |
+
## Usage Details ##
|
44 |
+
|
45 |
Any technical details can be found on the
|
46 |
[original model card](https://huggingface.co/stabilityai/stablelm-3b-4e1t) and in
|
47 |
a paper on [StableLM-3B-4E1T](https://stability.wandb.io/stability-llm/stable-lm/reports/StableLM-3B-4E1T--VmlldzoyMjU4?accessToken=u3zujipenkx5g7rtcj9qojjgxpconyjktjkli2po09nffrffdhhchq045vp0wyfo).
|
|
|
51 |
* there does not seem to be a specific prompt structure - just provide the text
|
52 |
you want to be completed
|
53 |
|
54 |
+
## License ##
|
55 |
+
|
56 |
+
The original "_Model checkpoints are licensed under the Creative Commons license
|
57 |
([CC BY-SA-4.0](https://creativecommons.org/licenses/by-sa/4.0/)). Under this
|
58 |
license, you must give [credit](https://creativecommons.org/licenses/by/4.0/#)
|
59 |
to Stability AI, provide a link to the license, and
|