Hugging Face's logo

legraphista
/
Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation
GGUF
English
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
Hermes-3-Llama-3.1-8B-IMat-GGUF / .gitattributes

Commit History

Upload Hermes-3-Llama-3.1-8B.IQ1_S.gguf with huggingface_hub
e769d7d
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ1_M.gguf with huggingface_hub
0c1f7c6
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ2_XXS.gguf with huggingface_hub
89be961
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ2_M.gguf with huggingface_hub
c3b8612
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ2_XS.gguf with huggingface_hub
02c9828
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ2_S.gguf with huggingface_hub
c1dceab
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ3_XXS.gguf with huggingface_hub
a765d33
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ3_XS.gguf with huggingface_hub
4392654
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ3_S.gguf with huggingface_hub
4009588
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ3_M.gguf with huggingface_hub
c1580f9
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ4_XS.gguf with huggingface_hub
affe90d
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.IQ4_NL.gguf with huggingface_hub
959c378
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q2_K_S.gguf with huggingface_hub
98d1ea8
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q3_K_S.gguf with huggingface_hub
2e74bb7
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q3_K_L.gguf with huggingface_hub
330cd5c
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q4_K_S.gguf with huggingface_hub
25ac413
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q2_K.gguf with huggingface_hub
20b5bb8
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q3_K.gguf with huggingface_hub
0a6f092
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.FP16.gguf with huggingface_hub
2cd20c9
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q4_K.gguf with huggingface_hub
7d27d41
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q5_K_S.gguf with huggingface_hub
d03a363
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q5_K.gguf with huggingface_hub
333fa64
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.BF16.gguf with huggingface_hub
a53d455
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q6_K.gguf with huggingface_hub
c2fba32
verified

legraphista commited on

Upload Hermes-3-Llama-3.1-8B.Q8_0.gguf with huggingface_hub
9e89062
verified

legraphista commited on

Upload imatrix.dat with huggingface_hub
e9a001e
verified

legraphista commited on

initial commit
d5abdce
verified

legraphista commited on