Hugging Face's logo

Lewdiculous
/
Chaos_RP_l3_8B-GGUF-IQ-Imatrix

GGUF
roleplay
llama3
sillytavern
Inference Endpoints
imatrix
Model card Files Community
1
Lewdiculous commited on
Commit
416c96c
•
1 Parent(s): 4f9ae40

UPDATED! New quants!

Browse files
Files changed (12) hide show
  1. Chaos_RP_l3_8B-F16.gguf +3 -0
  2. Chaos_RP_l3_8B-IQ3_M-imat.gguf +3 -0
  3. Chaos_RP_l3_8B-IQ3_XXS-imat.gguf +3 -0
  4. Chaos_RP_l3_8B-IQ4_NL-imat.gguf +3 -0
  5. Chaos_RP_l3_8B-IQ4_XS-imat.gguf +3 -0
  6. Chaos_RP_l3_8B-Q4_K_M-imat.gguf +3 -0
  7. Chaos_RP_l3_8B-Q4_K_S-imat.gguf +3 -0
  8. Chaos_RP_l3_8B-Q5_K_M-imat.gguf +3 -0
  9. Chaos_RP_l3_8B-Q5_K_S-imat.gguf +3 -0
  10. Chaos_RP_l3_8B-Q6_K-imat.gguf +3 -0
  11. Chaos_RP_l3_8B-Q8_0-imat.gguf +3 -0
  12. imatrix.dat +3 -0
Chaos_RP_l3_8B-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5f2c9029aabb292db45779b763642df9b6e2eae9bd2f9f3027e9ecbbe5aab18
3
+ size 16068890432
Chaos_RP_l3_8B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c0fd05f497911103a8e39ddbe1042cabb3f2cb517b32a6a68ea4422d1b3307e
3
+ size 3784822944
Chaos_RP_l3_8B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:088b3681abc0a6f048f909915c806624931c5f78616fb643444ee3182a46bff2
3
+ size 3274911904
Chaos_RP_l3_8B-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24965afbfbaefa7315637d7c9a71b1a059ebe950f4226a627a691101fdceb848
3
+ size 4677988512
Chaos_RP_l3_8B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12c203fdff2bc5499474fea9402d3f1ddb21945e93f5f6676c9fea896b7de778
3
+ size 4447662240
Chaos_RP_l3_8B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5774595ad560e4d258dac17723509bdefe746c4dacd4e679a0de00346f14d2f3
3
+ size 4920733856
Chaos_RP_l3_8B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da4b5d8fc4d0332e13d2dadd9ffe18495699b2f355cae9167acc5f07f35540a5
3
+ size 4692668576
Chaos_RP_l3_8B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76ebd969aba5c3070bbcbb472a53254c5ee82f29b8f1ef64c97f2f9f3d4b31a0
3
+ size 5732987040
Chaos_RP_l3_8B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc8c386d22e6e7adbe05a2887310613014d6e4bbe0e4087935442f179a0d06c0
3
+ size 5599293600
Chaos_RP_l3_8B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fce830eae8d18b747fd745da558438ea02109ba825630e6e7406ae6ee57e77dd
3
+ size 6596006048
Chaos_RP_l3_8B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0237536da50ea7a6e13538601d30ed7bfdd284f3085cce7dc7d78decc3029c8b
3
+ size 8540770464
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e626a67172c6f52772a29d554d8cd71cc88fdef42620f0dcd4de50c65b669600
3
+ size 4988193