neopolita
/

gemma-2-9b-it-gguf

Inference Endpoints

Model card Files Files and versions Community

gemma-2-9b-it-gguf

1 contributor

History: 9 commits

neopolita's picture

Upload gemma-2-9b-it_q8_0.gguf with huggingface_hub

3b47681 verified 6 months ago

.gitattributes

1.94 kB

Upload gemma-2-9b-it_q8_0.gguf with huggingface_hub 6 months ago
README.md

1.4 kB

Upload README.md with huggingface_hub 6 months ago
gemma-2-9b-it_q2_k.gguf

3.81 GB
LFS

Upload gemma-2-9b-it_q2_k.gguf with huggingface_hub 6 months ago
gemma-2-9b-it_q3_k_m.gguf

4.76 GB
LFS

Upload gemma-2-9b-it_q3_k_m.gguf with huggingface_hub 6 months ago
gemma-2-9b-it_q4_k_m.gguf

5.76 GB
LFS

Upload gemma-2-9b-it_q4_k_m.gguf with huggingface_hub 6 months ago
gemma-2-9b-it_q5_k_m.gguf

6.65 GB
LFS

Upload gemma-2-9b-it_q5_k_m.gguf with huggingface_hub 6 months ago
gemma-2-9b-it_q6_k.gguf

7.59 GB
LFS

Upload gemma-2-9b-it_q6_k.gguf with huggingface_hub 6 months ago
gemma-2-9b-it_q8_0.gguf

9.83 GB
LFS

Upload gemma-2-9b-it_q8_0.gguf with huggingface_hub 6 months ago
ggml-model-f16.gguf

18.5 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 6 months ago