neopolita
/

hermes-2-theta-llama-3-8b-gguf

Inference Endpoints

Model card Files Files and versions Community

hermes-2-theta-llama-3-8b-gguf

1 contributor

History: 10 commits

neopolita's picture

Upload hermes-2-theta-llama-3-8b_q2_k.gguf with huggingface_hub

1c6cdc9 verified 8 months ago

.gitattributes

2.01 kB

Upload hermes-2-theta-llama-3-8b_q2_k.gguf with huggingface_hub 8 months ago
README.md

1.46 kB

Upload README.md with huggingface_hub 8 months ago
ggml-model-f16.gguf

16.1 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 8 months ago
hermes-2-theta-llama-3-8b_q2_k.gguf

3.18 GB
LFS

Upload hermes-2-theta-llama-3-8b_q2_k.gguf with huggingface_hub 8 months ago
hermes-2-theta-llama-3-8b_q3_k_m.gguf

4.02 GB
LFS

Upload hermes-2-theta-llama-3-8b_q3_k_m.gguf with huggingface_hub 8 months ago
hermes-2-theta-llama-3-8b_q4_k_m.gguf

4.92 GB
LFS

Upload hermes-2-theta-llama-3-8b_q4_k_m.gguf with huggingface_hub 8 months ago
hermes-2-theta-llama-3-8b_q5_k_m.gguf

5.73 GB
LFS

Upload hermes-2-theta-llama-3-8b_q5_k_m.gguf with huggingface_hub 8 months ago
hermes-2-theta-llama-3-8b_q6_k.gguf

6.6 GB
LFS

Upload hermes-2-theta-llama-3-8b_q6_k.gguf with huggingface_hub 8 months ago
hermes-2-theta-llama-3-8b_q8_0.gguf

8.54 GB
LFS

Upload hermes-2-theta-llama-3-8b_q8_0.gguf with huggingface_hub 8 months ago