Hugging Face's logo

Lewdiculous
/
Elly_7B-GGUF-IQ-Imatrix

Transformers
GGUF
English
mistral
quantized
experimental
Model card Files Community
1
Lewdiculous commited on
Commit
07d3974
·
verified ·
1 Parent(s): 2b2a571

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Elly_7B-Q5_K_M-imat.gguf +3 -0
  3. Elly_7B-Q5_K_S-imat.gguf +3 -0
  4. Elly_7B-Q6_K-imat.gguf +3 -0
  5. Elly_7B-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,7 @@ Elly_7B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
  Elly_7B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Elly_7B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
38
  Elly_7B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Elly_7B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
41
+ Elly_7B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Elly_7B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Elly_7B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Elly_7B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
Elly_7B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5166745eaa192d3b675d68416e40e143975f2ab8576a2f8ddf5d59c7f56383d0
3
+ size 5131409152
Elly_7B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fb37ac1108cac14132703643534018c0d0c49dbc7297756b89f1cea20e08ca0
3
+ size 4997715712
Elly_7B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5271386b2eba1d55982eb787e7a38f5da825b6bf0b489e554cd13c27a765de0
3
+ size 5942064896
Elly_7B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ce0af65e960bd42e0a2d7879756590900df6e79db0c2f8aac2e863ed3798b98
3
+ size 7695857408