Hugging Face's logo

ThomasBaruzier
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
PyTorch
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
Meta-Llama-3.1-8B-Instruct-GGUF

Commit History

Upload Meta-Llama-3.1-8B-Instruct-F16.gguf
269c264
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q8_0.gguf
2610633
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q6_K.gguf
9104aa4
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q5_1.gguf
410153e
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf
898b243
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q5_0.gguf
ab1abb5
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf
f61af01
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q4_1.gguf
c2f3de4
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf
ff60c9c
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf
5cddd0f
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ4_NL.gguf
0850a6c
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q4_0.gguf
057ffac
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ4_XS.gguf
d9cf4cc
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf
9a4f6c4
verified

ThomasBaruzier commited on

Delete ggml-model-IQ1_S.gguf
daa2f5b
verified

ThomasBaruzier commited on

Delete ggml-model-IQ1_M.gguf
18932f2
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf
cd25e5e
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ3_M.gguf
5694c91
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ3_S.gguf
c541396
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf
701b807
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ3_XS.gguf
59711b4
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ3_XXS.gguf
004eaad
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q2_K.gguf
a008b1e
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-Q2_K_S.gguf
602898a
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ2_M.gguf
c26325a
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ2_S.gguf
f608b08
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ2_XS.gguf
b59f31c
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ2_XXS.gguf
6695ce0
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ1_M.gguf
6cf4311
verified

ThomasBaruzier commited on

Upload Meta-Llama-3.1-8B-Instruct-IQ1_S.gguf
97e38f0
verified

ThomasBaruzier commited on

Upload 1bit quants
5c9ff58
verified

ThomasBaruzier commited on

Upload calibration_datav3.txt
46a0ed2
verified

ThomasBaruzier commited on

Upload imatrix.dat
d1baddd
verified

ThomasBaruzier commited on

Update .gitattributes
6261401
verified

ThomasBaruzier commited on