QuantFactory
/

Moistral-11B-v3-GGUF

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

Moistral-11B-v3-GGUF

1 contributor

History: 16 commits

aashish1904's picture

Upload Moistral-11B-v3.Q4_K_S.gguf with huggingface_hub

e601208 verified 4 months ago

.gitattributes

2.4 kB

Upload Moistral-11B-v3.Q4_K_S.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q2_K.gguf

4 GB
LFS

Upload Moistral-11B-v3.Q2_K.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q3_K_L.gguf

5.65 GB
LFS

Upload Moistral-11B-v3.Q3_K_L.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q3_K_M.gguf

5.2 GB
LFS

Upload Moistral-11B-v3.Q3_K_M.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q3_K_S.gguf

4.66 GB
LFS

Upload Moistral-11B-v3.Q3_K_S.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q4_0.gguf

6.07 GB
LFS

Upload Moistral-11B-v3.Q4_0.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q4_1.gguf

6.73 GB
LFS

Upload Moistral-11B-v3.Q4_1.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q4_K_M.gguf

6.46 GB
LFS

Upload Moistral-11B-v3.Q4_K_M.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q4_K_S.gguf

6.12 GB
LFS

Upload Moistral-11B-v3.Q4_K_S.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q5_0.gguf

7.4 GB
LFS

Upload Moistral-11B-v3.Q5_0.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q5_1.gguf

8.06 GB
LFS

Upload Moistral-11B-v3.Q5_1.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q5_K_M.gguf

7.6 GB
LFS

Upload Moistral-11B-v3.Q5_K_M.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q5_K_S.gguf

7.4 GB
LFS

Upload Moistral-11B-v3.Q5_K_S.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q6_K.gguf

8.81 GB
LFS

Upload Moistral-11B-v3.Q6_K.gguf with huggingface_hub 4 months ago
Moistral-11B-v3.Q8_0.gguf

11.4 GB
LFS

Upload Moistral-11B-v3.Q8_0.gguf with huggingface_hub 4 months ago
README.md

25.8 kB

Upload README.md with huggingface_hub 4 months ago