Quant-Cartel
/

0x01-8x7b-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

0x01-8x7b-iMat-GGUF

1 contributor

History: 23 commits

InferenceIllusionist's picture

InferenceIllusionist

Upload 0x01-8x7b-iMat-Q5_K_S.gguf

88d4c67 verified 7 months ago

.gitattributes

2.58 kB

Upload 0x01-8x7b-iMat-Q5_K_S.gguf 7 months ago
0x01-8x7b-iMat-IQ2_M.gguf
15.5 GB
LFS

Upload 0x01-8x7b-iMat-IQ2_M.gguf 7 months ago
0x01-8x7b-iMat-IQ2_S.gguf
14.1 GB
LFS

Upload 0x01-8x7b-iMat-IQ2_S.gguf 7 months ago
0x01-8x7b-iMat-IQ2_XS.gguf
13.9 GB
LFS

Upload 0x01-8x7b-iMat-IQ2_XS.gguf 7 months ago
0x01-8x7b-iMat-IQ3_M.gguf
21.4 GB
LFS

Upload 0x01-8x7b-iMat-IQ3_M.gguf 7 months ago
0x01-8x7b-iMat-IQ3_S.gguf
20.4 GB
LFS

Rename 0x01-8x7b-hf-IQ3_S.gguf to 0x01-8x7b-iMat-IQ3_S.gguf 7 months ago
0x01-8x7b-iMat-IQ3_XS.gguf
19.3 GB
LFS

Upload 0x01-8x7b-iMat-IQ3_XS.gguf 7 months ago
0x01-8x7b-iMat-IQ3_XXS.gguf
18.2 GB
LFS

Upload 0x01-8x7b-iMat-IQ3_XXS.gguf 7 months ago
0x01-8x7b-iMat-IQ4_XS.gguf
25.1 GB
LFS

Rename 0x01-8x7b-hf-IQ4_XS.gguf to 0x01-8x7b-iMat-IQ4_XS.gguf 7 months ago
0x01-8x7b-iMat-Q4_K_M.gguf
28.4 GB
LFS

Rename 0x01-8x7b-hf-iMat-Q4_K_M.gguf to 0x01-8x7b-iMat-Q4_K_M.gguf 7 months ago
0x01-8x7b-iMat-Q4_K_S.gguf
26.7 GB
LFS

Rename 0x01-8x7b-Q4_K_S.gguf to 0x01-8x7b-iMat-Q4_K_S.gguf 7 months ago
0x01-8x7b-iMat-Q5_K_M.gguf
33.2 GB
LFS

Rename 0x01-8x7b-imat-Q5_K_M.gguf to 0x01-8x7b-iMat-Q5_K_M.gguf 7 months ago
0x01-8x7b-iMat-Q5_K_S.gguf
32.2 GB
LFS

Upload 0x01-8x7b-iMat-Q5_K_S.gguf 7 months ago
0x01-8x7b-iMat-Q6_K.gguf
38.4 GB
LFS

Upload 0x01-8x7b-iMat-Q6_K.gguf 7 months ago
README.md

1.54 kB

Update README.md 7 months ago