gurro
/

Llama-3.1-8B-awq-int4-g128-GEMM

4-bit precision

Model card Files Files and versions Community

Llama-3.1-8B-awq-int4-g128-GEMM

1 contributor

History: 6 commits

gurro's picture

Upload model.safetensors.index.json with huggingface_hub

cfaafa8 verified 19 days ago

.gitattributes

1.52 kB

initial commit 19 days ago
config.json

1.16 kB

Upload config.json with huggingface_hub 19 days ago
generation_config.json

180 Bytes

Upload generation_config.json with huggingface_hub 19 days ago
model-00001-of-00002.safetensors

4.68 GB
LFS

Upload model-00001-of-00002.safetensors with huggingface_hub 19 days ago
model-00002-of-00002.safetensors

1.05 GB
LFS

Upload model-00002-of-00002.safetensors with huggingface_hub 19 days ago
model.safetensors.index.json

60.5 kB

Upload model.safetensors.index.json with huggingface_hub 19 days ago