MaziyarPanahi
/

Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-GGUF

1 contributor

History: 4 commits

MaziyarPanahi's picture

1631249b035a5f99ff14d8afa45121321fdfb1f7e72ee8e5d9b69acb5960eb99

a73b6a1 verified 7 months ago

.gitattributes

1.75 kB

1631249b035a5f99ff14d8afa45121321fdfb1f7e72ee8e5d9b69acb5960eb99 7 months ago
Meta-Llama-3.1-70B-Instruct.Q2_K.gguf

26.4 GB
LFS

2b3c4d77c4eb8c500e90da8f9b46d958796ed1dc7239b4af501706db15f2ab7d 7 months ago
Meta-Llama-3.1-70B-Instruct.Q3_K_L.gguf

37.1 GB
LFS

39bdc99bfcb15b687b622fec3f198b6815ed165e8bd27a8c04d87115576ae6d0 7 months ago
Meta-Llama-3.1-70B-Instruct.Q3_K_M.gguf

34.3 GB
LFS

1631249b035a5f99ff14d8afa45121321fdfb1f7e72ee8e5d9b69acb5960eb99 7 months ago
README.md

29 Bytes

initial commit 7 months ago