Text Generation
Transformers
Safetensors
English
mistral
conversational
text-generation-inference
Inference Endpoints
8-bit precision
exl2
Statuo commited on
Commit
faec843
1 Parent(s): 559ff94

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -8,6 +8,17 @@ datasets:
8
  - nothingiisreal/Reddit-Dirty-And-WritingPrompts
9
  license: apache-2.0
10
  ---
 
 
 
 
 
 
 
 
 
 
 
11
 
12
  <style>
13
  h1, h2, h3, h4, h5, h6 {
 
8
  - nothingiisreal/Reddit-Dirty-And-WritingPrompts
9
  license: apache-2.0
10
  ---
11
+ Not much to say here. I waited on this one like I did with NemoMix because I got the vibe of constant updates meaning it was pointless to tie my PC up for hours just to quant something that would have a new update the next day.
12
+ <br>
13
+
14
+ [This is the EXL2 8bpw Quant of Celeste v1.9. Find the original model here](https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9)
15
+ <br>
16
+ [Find the 6bpw Quant here](https://huggingface.co/Statuo/Celeste-v1.9-6bpw-EXL2)
17
+ <br>
18
+ [Find the 4bpw Quant here](https://huggingface.co/Statuo/Celeste-v1.9-4bpw-EXL2)
19
+ <br>
20
+
21
+
22
 
23
  <style>
24
  h1, h2, h3, h4, h5, h6 {