Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Sailor2-8B-Chat-GGUF
like
3
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Sailor2-8B-Chat-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
6fdf36f6a3509bdab80cc85173da80ebacf5d4742dd6344f2a5e83edc20e4c3d
0badce9
verified
about 1 month ago
.gitattributes
Safe
2.28 kB
6fdf36f6a3509bdab80cc85173da80ebacf5d4742dd6344f2a5e83edc20e4c3d
about 1 month ago
README.md
Safe
2.88 kB
6fdf36f6a3509bdab80cc85173da80ebacf5d4742dd6344f2a5e83edc20e4c3d
about 1 month ago
Sailor2-8B-Chat-GGUF_imatrix.dat
5.18 MB
LFS
6fdf36f6a3509bdab80cc85173da80ebacf5d4742dd6344f2a5e83edc20e4c3d
about 1 month ago
Sailor2-8B-Chat.Q2_K.gguf
3.36 GB
LFS
6d650b79302e21eaef92115e80cf73953eeced1689b76b3f3510ba2020d2b319
about 1 month ago
Sailor2-8B-Chat.Q3_K_L.gguf
4.57 GB
LFS
e017d449208326ba1fc942d5c6e07dcf153317589d92dec670b2d00f70f8a0d3
about 1 month ago
Sailor2-8B-Chat.Q3_K_M.gguf
4.26 GB
LFS
63f72c94eba3f9fd0b1b2f510dbab9e2dda4c0a58d1ac2aa27d72e689f711890
about 1 month ago
Sailor2-8B-Chat.Q3_K_S.gguf
3.89 GB
LFS
18072dbd0b1c1d8c8592fc8112741600769fbac9bbdb75f82472e9e840b28755
about 1 month ago
Sailor2-8B-Chat.Q4_K_M.gguf
5.24 GB
LFS
032830708ce9597455b81064774b42f08fe04fc0c58c4b6609d57d49d97f4f83
about 1 month ago
Sailor2-8B-Chat.Q4_K_S.gguf
4.99 GB
LFS
eb64caf0bc747eda5906a93c31530ab013db881a20e8306ca6412f6181b92023
about 1 month ago
Sailor2-8B-Chat.Q5_K_M.gguf
6.1 GB
LFS
74d1db3aa151521a9e3b611e1da3d71bf03dfbc343d870dba73029d577982941
about 1 month ago
Sailor2-8B-Chat.Q5_K_S.gguf
5.96 GB
LFS
3c77096ebb105c001e8e6c2e1ca59ccb92d839a04f097dd6cd71d50b630e1383
about 1 month ago
Sailor2-8B-Chat.Q6_K.gguf
7.02 GB
LFS
760bc48f1bbcb0e3a03bffaedcf77aba4c2080c89084f378f826973336be6257
about 1 month ago
Sailor2-8B-Chat.Q8_0.gguf
9.09 GB
LFS
52708b8b8f73ad3266f6882121058fe432bf4275727f504f50dd091d9c870984
about 1 month ago
Sailor2-8B-Chat.fp16.gguf
17.1 GB
LFS
89f6942a6c71fd74e920d519ac3c43bad8cd956fffbf95ac8eaf14e523362fac
about 1 month ago