Not-For-All-Audiences

iMat

GGUF

Inference Endpoints

imatrix

conversational

Model card Files Files and versions Community

Mistral-Small-NovusKyver-iMat-GGUF

1 contributor

History: 14 commits

InferenceIllusionist

Update README.md

8443a0c verified 5 months ago

.gitattributes

3.07 kB

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-F32.imatrix

11.9 MB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ2_M.gguf

7.62 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ2_S.gguf

7.04 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ2_XS.gguf

6.65 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ2_XXS.gguf

6 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ3_M.gguf

10.1 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ3_S.gguf

9.69 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ3_XS.gguf

9.18 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ3_XXS.gguf

8.6 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-IQ4_XS.gguf

11.9 GB
LFS

Upload 5 files 5 months ago
Mistral-Small-NovusKyver-iMat-Q2_K.gguf

8.27 GB
LFS

Upload 2 files 5 months ago
Mistral-Small-NovusKyver-iMat-Q3_K_L.gguf

11.7 GB
LFS

Upload 2 files 5 months ago
Mistral-Small-NovusKyver-iMat-Q3_K_M.gguf

10.8 GB
LFS

Upload 2 files 5 months ago
Mistral-Small-NovusKyver-iMat-Q3_K_S.gguf

9.64 GB
LFS

Upload 2 files 5 months ago
Mistral-Small-NovusKyver-iMat-Q4_K_M.gguf

13.3 GB
LFS

Upload 2 files 5 months ago
Mistral-Small-NovusKyver-iMat-Q4_K_S.gguf

12.7 GB
LFS

Upload 2 files 5 months ago
Mistral-Small-NovusKyver-iMat-Q5_K_M.gguf

15.7 GB
LFS

Upload Mistral-Small-NovusKyver-iMat-Q5_K_M.gguf 5 months ago
Mistral-Small-NovusKyver-iMat-Q5_K_S.gguf

15.3 GB
LFS

Upload Mistral-Small-NovusKyver-iMat-Q5_K_S.gguf 5 months ago
Mistral-Small-NovusKyver-iMat-Q6_K.gguf

18.3 GB
LFS

Upload Mistral-Small-NovusKyver-iMat-Q6_K.gguf 5 months ago
Mistral-Small-NovusKyver-iMat-Q8_0.gguf

23.6 GB
LFS

Upload Mistral-Small-NovusKyver-iMat-Q8_0.gguf 5 months ago
README.md

2.5 kB

Update README.md 5 months ago