xaskasdf
/

llama-3.1-70b-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

llama-3.1-70b-instruct-gguf

1 contributor

History: 5 commits

xaskasdf's picture

Upload llama-3.1-70b-instruct-q5_0.gguf

05f120e verified 6 months ago

.gitattributes

1.8 kB

Upload llama-3.1-70b-instruct-q5_0.gguf 6 months ago
README.md

29 Bytes

initial commit 6 months ago
llama-3.1-70b-instruct-q2_k.gguf

27.6 GB
LFS

Upload llama-3.1-70b-instruct-q2_k.gguf 6 months ago
llama-3.1-70b-instruct-q3_k.gguf

35.5 GB
LFS

Upload llama-3.1-70b-instruct-q3_k.gguf 6 months ago
llama-3.1-70b-instruct-q4_k.gguf

43.8 GB
LFS

Upload llama-3.1-70b-instruct-q4_k.gguf 6 months ago
llama-3.1-70b-instruct-q5_0.gguf

49.9 GB
LFS

Upload llama-3.1-70b-instruct-q5_0.gguf 6 months ago