Hugging Face's logo

tachyphylaxis
/
Merged-Vicuna-RP-Stew-34B-GGUF

GGUF
Inference Endpoints
Model card Files Community
tachyphylaxis commited on
Commit
04d4c39
•
1 Parent(s): 1f90c29

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +5 -0
  2. Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf +3 -0
  3. Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf +3 -0
  4. Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf +3 -0
  5. Merged-Vicuna-RP-Stew-34B.Q6_K.gguf +3 -0
  6. Merged-Vicuna-RP-Stew-34B.Q8_0.gguf +3 -0
  7. README.md +19 -0
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Merged-Vicuna-RP-Stew-34B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Merged-Vicuna-RP-Stew-34B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f54725e27f56f7688cebf1b216f4eb2acecb826cb0af54b06fcb90474f286194
3
+ size 19650049408
Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:918cdaf7af83acc83fc0ad12b158f7b190e4fd3b0439f712e1f1da4d8a1bce7f
3
+ size 20658730368
Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3293c8343387e07bae738a71cdf2dc5a235d0fccd28e1fa41f27ca5612d73eac
3
+ size 24321866880
Merged-Vicuna-RP-Stew-34B.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af7c3d20ce29f8a67cc2eb44f907d1020df47a9b02082d62444e741900a9aa85
3
+ size 28213949440
Merged-Vicuna-RP-Stew-34B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c17be5c20725a56359ce1297fe9d6b14d3b6497d9c9686e3c852b9f57b9e7ef
3
+ size 36542312192
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: yi-34b
4
+ license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
5
+ tags:
6
+ - merge
7
+ - roleplay
8
+ - not-for-all-audiences
9
+ ---
10
+
11
+ # Some GGUF quants of ParasiticRogue/Merged-Vicuna-RP-Stew-34B-GGUF
12
+
13
+ See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know.
14
+
15
+ 19G Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf
16
+ 20G Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf
17
+ 23G Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf
18
+ 27G Merged-Vicuna-RP-Stew-34B.Q6_K.gguf
19
+ 35G Merged-Vicuna-RP-Stew-34B.Q8_0.gguf