rozek commited on
Commit
282d944
·
1 Parent(s): 8f49885

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -2
README.md CHANGED
@@ -7,8 +7,18 @@ This repository contains the most relevant quantizations of Stability AI's
7
  in GGUF format - ready to be used with
8
  [llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
9
 
10
- The upload takes place with the written permission of Stability AI - although
11
- access to the model itself is "gated". The chosen license is the same as that
 
 
 
 
 
 
 
 
 
 
12
  of the original model.
13
 
14
  (more details will follow a.s.a.p.)
 
7
  in GGUF format - ready to be used with
8
  [llama.cpp](https://github.com/ggerganov/llama.cpp) and similar applications.
9
 
10
+ Right now, the following quantizations are available:
11
+
12
+ * [stablelm-3b-4e1t-Q4_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q4_K_M.bin)
13
+ * [stablelm-3b-4e1t-Q5_K_M](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q5_K_M.bin)
14
+ * [stablelm-3b-4e1t-Q6_K](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q6_K.bin)
15
+ * [stablelm-3b-4e1t-Q8_K](https://huggingface.co/rozek/StableLM-3B-4E1T_GGUF/blob/main/stablelm-3b-4e1t-Q8_K.bin)
16
+
17
+ These files are presented here with the written permission of Stability AI (although
18
+ access to the model itself is "gated").
19
+
20
+
21
+ The chosen license is the same as that
22
  of the original model.
23
 
24
  (more details will follow a.s.a.p.)