MaziyarPanahi
/

Llama-3-13B-Instruct-v0.1-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions Community

Llama-3-13B-Instruct-v0.1-GGUF

1 contributor

History: 7 commits

MaziyarPanahi's picture

low quality - will make one with imatrix (#4)

11e8313 verified 6 months ago

.gitattributes

2.47 kB

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q2_K.gguf
5.11 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q3_K_L.gguf
7.07 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q3_K_M.gguf
6.53 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q3_K_S.gguf
5.92 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q4_K_M.gguf
8.06 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q4_K_S.gguf
7.66 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q5_K_M.gguf
9.43 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q5_K_S.gguf
9.2 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q6_K.gguf
10.9 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.Q8_0.gguf
14.1 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
Llama-3-13B-Instruct-v0.1.fp16.gguf
26.5 GB
LFS

Upload folder using huggingface_hub (#1) 6 months ago
README.md

1.55 kB

Update README.md (#3) 6 months ago
config.json

31 Bytes

Upload folder using huggingface_hub 6 months ago