ThomasBaruzier
/

Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-8B-Instruct-GGUF

Commit History

Upload Meta-Llama-3.1-8B-Instruct-IQ1_M.gguf

1f8a57a
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-IQ1_S.gguf

4731186
verified

ThomasBaruzier commited on Jul 31

Upload imatrix.dat

9973882
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-8B-Instruct-Q4_0_4_8.gguf

0c6552a
verified

ThomasBaruzier commited on Jul 30

Upload Meta-Llama-3.1-8B-Instruct-Q4_0_8_8.gguf

c8f2b6a
verified

ThomasBaruzier commited on Jul 30

Upload Meta-Llama-3.1-8B-Instruct-Q4_0_4_4.gguf

bb348c8
verified

ThomasBaruzier commited on Jul 30

Update README.md

ab75ef7
verified

ThomasBaruzier commited on Jul 29

Update README.md

f01d1d6
verified

ThomasBaruzier commited on Jul 28

Update README.md

c79a914
verified

ThomasBaruzier commited on Jul 28

Upload Meta-Llama-3.1-8B-Instruct-F16.gguf

269c264
verified

ThomasBaruzier commited on Jul 27

Update README.md

4d58a94
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q8_0.gguf

2610633
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q6_K.gguf

9104aa4
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_1.gguf

410153e
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

898b243
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_0.gguf

ab1abb5
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf

f61af01
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_1.gguf

c2f3de4
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf

ff60c9c
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf

5cddd0f
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ4_NL.gguf

0850a6c
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q4_0.gguf

057ffac
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ4_XS.gguf

d9cf4cc
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf

9a4f6c4
verified

ThomasBaruzier commited on Jul 27

Delete ggml-model-IQ1_S.gguf

daa2f5b
verified

ThomasBaruzier commited on Jul 27

Delete ggml-model-IQ1_M.gguf

18932f2
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf

cd25e5e
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ3_M.gguf

5694c91
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ3_S.gguf

c541396
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf

701b807
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ3_XS.gguf

59711b4
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ3_XXS.gguf

004eaad
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q2_K.gguf

a008b1e
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-Q2_K_S.gguf

602898a
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ2_M.gguf

c26325a
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ2_S.gguf

f608b08
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ2_XS.gguf

b59f31c
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ2_XXS.gguf

6695ce0
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ1_M.gguf

6cf4311
verified

ThomasBaruzier commited on Jul 27

Upload Meta-Llama-3.1-8B-Instruct-IQ1_S.gguf

97e38f0
verified

ThomasBaruzier commited on Jul 27

Update README.md

3479a71
verified

ThomasBaruzier commited on Jul 27

Upload 1bit quants

5c9ff58
verified

ThomasBaruzier commited on Jul 27

Upload calibration_datav3.txt

46a0ed2
verified

ThomasBaruzier commited on Jul 27

Upload imatrix.dat

d1baddd
verified

ThomasBaruzier commited on Jul 27

Update .gitattributes

6261401
verified

ThomasBaruzier commited on Jul 27

Update README.md

f1be5e3
verified

ThomasBaruzier commited on Jul 27

initial commit

eb50547
verified

ThomasBaruzier commited on Jul 27