Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
c7e1b90
•
1 Parent(s): 592469a

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00001-of-00009.gguf +3 -0
  3. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00002-of-00009.gguf +3 -0
  4. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00003-of-00009.gguf +3 -0
  5. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00004-of-00009.gguf +3 -0
  6. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00005-of-00009.gguf +3 -0
  7. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00006-of-00009.gguf +3 -0
  8. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00007-of-00009.gguf +3 -0
  9. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00008-of-00009.gguf +3 -0
  10. Q5_1/Mixtral-8x22B-v0.1-Q5_1-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -131,3 +131,12 @@ Q5_0/Mixtral-8x22B-v0.1-Q5_0-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -
131
  Q5_0/Mixtral-8x22B-v0.1-Q5_0-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
132
  Q5_0/Mixtral-8x22B-v0.1-Q5_0-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
133
  Q5_0/Mixtral-8x22B-v0.1-Q5_0-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
131
  Q5_0/Mixtral-8x22B-v0.1-Q5_0-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
132
  Q5_0/Mixtral-8x22B-v0.1-Q5_0-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
133
  Q5_0/Mixtral-8x22B-v0.1-Q5_0-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
134
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
135
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
136
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
137
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
138
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
139
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
140
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
141
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
142
+ Q5_1/Mixtral-8x22B-v0.1-Q5_1-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a250f6441f3832b869618481d77f70e1553451ccde5c6e54c7d5224af7aea18b
3
+ size 779436736
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8284e86624a08546b1fd65541814f4fabbcb0013907738528506e0c4b59e6a6
3
+ size 631361408
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:753b738b7e6f5f19162887c2e6717b6a4ea88da6dac3844e9ef3cf0781dfb56b
3
+ size 637947776
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8ba39a28475f4862cc83f487ac6986f1247ba134a308700f88475e2fee00c64
3
+ size 659574656
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:222c71684c04f339b9b971c1efd075cf1d584046627dfec5bd8210992255350f
3
+ size 659574656
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee1889f7bc1641fac660892cde6c60852f7122d6bea2a4ef55517da7cd706a48
3
+ size 637947776
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:170ed8908396e1799cac19546f6cc45417b3535897dbc5bee8998508479ed6e2
3
+ size 32242426432
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40f4d49399b22202268c5290839ad09d1128926f20226780fe87cb9c33a57316
3
+ size 38654710528
Q5_1/Mixtral-8x22B-v0.1-Q5_1-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a02ccd86f68e5d9c318db47c2f3feed62e8c506d3b04fe22f77472c7e703811d
3
+ size 30802972480