rozek commited on
Commit
2e12631
·
1 Parent(s): 67bcaed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -2
README.md CHANGED
@@ -2,12 +2,21 @@
2
  license: cc-by-sa-4.0
3
  ---
4
 
 
 
 
 
 
 
 
5
  This repository contains the most relevant quantizations of Stability AI's
6
  [StableLM-3B-4E1T](https://huggingface.co/stabilityai/stablelm-3b-4e1t) model
7
  in GGUF format - ready to be used with
8
  [llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
9
 
10
- For this model, Stability AI claims: "_StableLM-3B-4E1T achieves
 
 
11
  state-of-the-art performance (September 2023) at the 3B parameter scale
12
  for open-source models and is competitive with many of the popular
13
  contemporary 7B models, even outperforming our most recent 7B
@@ -17,6 +26,8 @@ According to them "_The model is intended to be used as a foundational base
17
  model for application-specific fine-tuning. Developers must evaluate and
18
  fine-tune the model for safe performance in downstream applications._"
19
 
 
 
20
  Right now, the following quantizations are available:
21
 
22
  * [stablelm-3b-4e1t-Q4_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q4_K_M.bin)
@@ -29,6 +40,8 @@ Right now, the following quantizations are available:
29
  These files are presented here with the written permission of Stability AI (although
30
  access to the model itself is still "gated").
31
 
 
 
32
  Any technical details can be found on the
33
  [original model card](https://huggingface.co/stabilityai/stablelm-3b-4e1t) and in
34
  a paper on [StableLM-3B-4E1T](https://stability.wandb.io/stability-llm/stable-lm/reports/StableLM-3B-4E1T--VmlldzoyMjU4?accessToken=u3zujipenkx5g7rtcj9qojjgxpconyjktjkli2po09nffrffdhhchq045vp0wyfo).
@@ -38,7 +51,9 @@ The most important ones for using this model are
38
  * there does not seem to be a specific prompt structure - just provide the text
39
  you want to be completed
40
 
41
- **License**: The original "_Model checkpoints are licensed under the Creative Commons license
 
 
42
  ([CC BY-SA-4.0](https://creativecommons.org/licenses/by-sa/4.0/)). Under this
43
  license, you must give [credit](https://creativecommons.org/licenses/by/4.0/#)
44
  to Stability AI, provide a link to the license, and
 
2
  license: cc-by-sa-4.0
3
  ---
4
 
5
+ # StableLM-3B-4E1T #
6
+
7
+ * Model Creator: [Stability AI](https://huggingface.co/stabilityai)
8
+ * original Model: [StableLM-3B-4E1T](https://huggingface.co/stabilityai/stablelm-3b-4e1t)
9
+
10
+ ## Description ##
11
+
12
  This repository contains the most relevant quantizations of Stability AI's
13
  [StableLM-3B-4E1T](https://huggingface.co/stabilityai/stablelm-3b-4e1t) model
14
  in GGUF format - ready to be used with
15
  [llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
16
 
17
+ ## About StableLM-3B-4E1T ##
18
+
19
+ Stability AI claims: "_StableLM-3B-4E1T achieves
20
  state-of-the-art performance (September 2023) at the 3B parameter scale
21
  for open-source models and is competitive with many of the popular
22
  contemporary 7B models, even outperforming our most recent 7B
 
26
  model for application-specific fine-tuning. Developers must evaluate and
27
  fine-tune the model for safe performance in downstream applications._"
28
 
29
+ ## Files ##
30
+
31
  Right now, the following quantizations are available:
32
 
33
  * [stablelm-3b-4e1t-Q4_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q4_K_M.bin)
 
40
  These files are presented here with the written permission of Stability AI (although
41
  access to the model itself is still "gated").
42
 
43
+ ## Usage Details ##
44
+
45
  Any technical details can be found on the
46
  [original model card](https://huggingface.co/stabilityai/stablelm-3b-4e1t) and in
47
  a paper on [StableLM-3B-4E1T](https://stability.wandb.io/stability-llm/stable-lm/reports/StableLM-3B-4E1T--VmlldzoyMjU4?accessToken=u3zujipenkx5g7rtcj9qojjgxpconyjktjkli2po09nffrffdhhchq045vp0wyfo).
 
51
  * there does not seem to be a specific prompt structure - just provide the text
52
  you want to be completed
53
 
54
+ ## License ##
55
+
56
+ The original "_Model checkpoints are licensed under the Creative Commons license
57
  ([CC BY-SA-4.0](https://creativecommons.org/licenses/by-sa/4.0/)). Under this
58
  license, you must give [credit](https://creativecommons.org/licenses/by/4.0/#)
59
  to Stability AI, provide a link to the license, and