xaskasdf
/

llama-3.1-8b-instruct-gguf

Model card Files Files and versions Community

llama-3.1-8b-instruct-gguf

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

xaskasdf's picture

Upload quantized models

51ccf50 verified 10 months ago

.gitattributes

2.33 kB

Upload quantized models 10 months ago
README.md

29 Bytes

initial commit 10 months ago
llama-3.1-8b-instruct-f16.gguf

16.1 GB
LFS

Upload converted model 10 months ago
llama-3.1-8b-instruct-iq1_m.gguf

2.85 GB
LFS

Upload heavily quantized models and importance matrix 10 months ago
llama-3.1-8b-instruct-iq2_xxs.gguf

3.09 GB
LFS

Upload heavily quantized models and importance matrix 10 months ago
llama-3.1-8b-instruct-q2_k.gguf

3.8 GB
LFS

Upload heavily quantized models and importance matrix 10 months ago
llama-3.1-8b-instruct-q3_k.gguf

4.64 GB
LFS

Upload heavily quantized models and importance matrix 10 months ago
llama-3.1-8b-instruct-q4_0.gguf

5.28 GB
LFS

Upload heavily quantized models and importance matrix 10 months ago
llama-3.1-8b-instruct-q4_k.gguf

5.54 GB
LFS

Upload heavily quantized models and importance matrix 10 months ago
llama-3.1-8b-instruct-q5_0.gguf

6.22 GB
LFS

Upload quantized models 10 months ago
llama-3.1-8b-instruct-q5_k.gguf

6.35 GB
LFS

Upload quantized models 10 months ago
llama-3.1-8b-instruct-q6_k.gguf

7.22 GB
LFS

Upload quantized models 10 months ago
llama-3.1-8b-instruct-q8_0.gguf

9.03 GB
LFS

Upload quantized models 10 months ago
llama-3.1-instruct.imatrix

4.99 MB
LFS

Upload heavily quantized models and importance matrix 10 months ago