neuralmagic
/

Llama-3.2-3B-quantized.w8a8

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Llama-3.2-3B-quantized.w8a8

Commit History

Updated compression_config to quantization_config

02d0329
verified

mgoin commited on Oct 9, 2024

Upload folder using huggingface_hub

4d12d86
verified

alexmarques commited on Sep 26, 2024

initial commit

89874f4
verified

alexmarques commited on Sep 26, 2024