Hugging Face's logo

MaziyarPanahi
/
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
7b
lazymergekit
mistralai/Mistral-7B-Instruct-v0.2
perlthoughts/Mistral-11B-Instruct-v0.2
Inference Endpoints
text-generation-inference
conversational
Model card Files Community
MaziyarPanahi commited on
Commit
1237d32
•
1 Parent(s): b1ba40a

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q2_K.gguf +2 -2
  2. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q3_K_L.gguf +2 -2
  3. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q3_K_M.gguf +2 -2
  4. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q3_K_S.gguf +2 -2
  5. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q4_K_M.gguf +2 -2
  6. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q4_K_S.gguf +2 -2
  7. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q5_K_M.gguf +2 -2
  8. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q5_K_S.gguf +2 -2
  9. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q6_K.gguf +2 -2
  10. Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q8_0.gguf +2 -2
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50b7f92ba73c3edfb5b3df37346cb953bb86ead49ec4db6191634ede8d065f01
3
- size 2720050752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:523a6146f28d7a3a61644060c00917967e34396e164c473105752a0c559cb4b0
3
+ size 2719242432
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:423b54c11e1f8a7f712c3370017c8cc78ccf70042a0489b393820f6eed623abe
3
- size 3822833216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d78e3e42ccdfe451cabe75797b7941747af5e099e6e78059543c28eb084b0a2
3
+ size 3822024896
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:20ff6b4f3a443e23794821723e82424b3cc6d01a6830cfdff2c9e444bdfe59e8
3
- size 3519794752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df59b00ce1a046169db251310e1bce245ad8c1a31788c6f3b8f80d62c6f36d2c
3
+ size 3518986432
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a029636b155be5510c6548dfc45574461456fc44b53800a57b60dc21892c3b6
3
- size 3165376064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8df6f593e0fd3c4de35598fd786564fb54ddaf7f458c5a68fc80bf38485d833
3
+ size 3164567744
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bddb78217007c97c6950da56bee492409cb779304747fae1ec85b809bdf6671e
3
- size 4369247808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:395782de67cc9e06292e57d44443cab0676cf3d3331233eea1a2fdeb316bd61d
3
+ size 4368439488
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3b4862d17f1f17aa468f89cf4fdbc12fa851015661f90ee44152d932f2b47f57
3
- size 4141182528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c2aa6887cfd0419ca0d20a91d873b90ca0f439cebe0ef938b7c614301dd79d9
3
+ size 4140374208
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:de03f7800ad9aafcf1bb8915799eba8ebc12b4e17cccd50ef942b76f2a2b0c33
3
- size 5132217920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eab41ae1328459dd7b699d36e739d5d046b089436e8e8aa57b204c30b68ddb32
3
+ size 5131409600
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f145733bacbbe7d0857aa916d200011a0dc35771e21a27f131a9d693ca41d2c5
3
- size 4998524480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6aa3816e7438c51975d4bc12be5207bfebf55c51aeb959f14eb58a4bd90cb59
3
+ size 4997716160
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6abc071d3eb898f34531cfbc2b2b6a8159dd74dd2188c93acbc034addd858386
3
- size 5942873664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9282e3eae1d77d04e2a8997544b6540fe9d75f3991b4d6e4af1d9255afdedb50
3
+ size 5942065344
Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ae7199282186099bd128bf3b43969d356420928b24180822002f5d03cf3b584
3
- size 7696666176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c685afc7691d69e81e0965cdd463083f5deec40697ef85a708f281494bb9f3aa
3
+ size 7695857856