qwp4w3hyb
/

Nous-Hermes-2-SOLAR-10.7B-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

Nous-Hermes-2-SOLAR-10.7B-iMat-GGUF

2 contributors

History: 15 commits

qwp4w3hyb's picture

Add ./nous-hermes-2-solar-10.7b-imat-Q4_K_S.gguf

74b333d unverified 9 months ago

.gitattributes

2.44 kB

Add ./nous-hermes-2-solar-10.7b-imat-Q4_K_S.gguf 9 months ago
README.md

951 Bytes

Fix README.md tags 9 months ago
imat-f16-gmerged.dat

7.48 MB
LFS

Add imat-f16-gmerged.dat 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ1_S.gguf

2.35 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ1_S.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ2_M.gguf

3.68 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ2_M.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ2_S.gguf

3.39 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ2_S.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ2_XS.gguf

3.23 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ2_XS.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ3_M.gguf

4.85 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ3_M.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ3_S.gguf

4.69 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ3_S.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ3_XS.gguf

4.42 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ3_XS.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ4_NL.gguf

6.1 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ4_NL.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-IQ4_XS.gguf

5.77 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-IQ4_XS.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-Q4_K_M.gguf

6.46 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-Q4_K_M.gguf 9 months ago
nous-hermes-2-solar-10.7b-imat-Q4_K_S.gguf

6.12 GB
LFS

Add ./nous-hermes-2-solar-10.7b-imat-Q4_K_S.gguf 9 months ago