bartowski
/

Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation

Model card Files Files and versions

Codestral-22B-v0.1-abliterated-v3-GGUF

289 GB

1 contributor

History: 2 commits

bartowski's picture

Llamacpp quants

1046e7c verified over 1 year ago

Codestral-22B-v0.1-abliterated-v3-f32.gguf
Llamacpp quants over 1 year ago
.gitattributes

3.39 kB

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-IQ2_M.gguf

7.62 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-IQ2_S.gguf

7.04 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-IQ2_XS.gguf

6.65 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-IQ3_M.gguf

10.1 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-IQ3_XS.gguf

9.18 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-IQ3_XXS.gguf

8.6 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-IQ4_XS.gguf

11.9 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q2_K.gguf

8.27 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q3_K_L.gguf

11.7 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q3_K_M.gguf

10.8 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q3_K_S.gguf

9.64 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q4_K_M.gguf

13.3 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q4_K_S.gguf

12.7 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q5_K_M.gguf

15.7 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q5_K_S.gguf

15.3 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q6_K.gguf

18.3 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3-Q8_0.gguf

23.6 GB
xet

Llamacpp quants over 1 year ago
Codestral-22B-v0.1-abliterated-v3.imatrix

11.9 MB
xet

Llamacpp quants over 1 year ago
README.md

7.99 kB

Llamacpp quants over 1 year ago