neopolita
/

granite-3.0-8b-base-gguf

Inference Endpoints

Model card Files Files and versions Community

granite-3.0-8b-base-gguf

1 contributor

History: 8 commits

neopolita's picture

Upload granite-3.0-8b-base_q5_k_m.gguf with huggingface_hub

99d3bf4 verified 2 months ago

.gitattributes

1.91 kB

Upload granite-3.0-8b-base_q5_k_m.gguf with huggingface_hub 2 months ago
README.md

1.44 kB

Upload README.md with huggingface_hub 2 months ago
ggml-model-f16.gguf

16.3 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 2 months ago
granite-3.0-8b-base_q2_k.gguf

3.1 GB
LFS

Upload granite-3.0-8b-base_q2_k.gguf with huggingface_hub 2 months ago
granite-3.0-8b-base_q3_k_m.gguf

4 GB
LFS

Upload granite-3.0-8b-base_q3_k_m.gguf with huggingface_hub 2 months ago
granite-3.0-8b-base_q4_k_m.gguf

4.94 GB
LFS

Upload granite-3.0-8b-base_q4_k_m.gguf with huggingface_hub 2 months ago
granite-3.0-8b-base_q5_k_m.gguf

5.8 GB
LFS

Upload granite-3.0-8b-base_q5_k_m.gguf with huggingface_hub 2 months ago
granite-3.0-8b-base_q8_0.gguf

8.68 GB
LFS

Upload granite-3.0-8b-base_q8_0.gguf with huggingface_hub 2 months ago