HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
meta-llama/Llama-3.2-1B Quantized
Find the quantized versions of Llama-3.2-1B all in one place
-
-
HF-Quantization/Llama-3.2-1B-BNB-INT8
Updated • 3 -
HF-Quantization/Llama-3.2-1B-BNB-NF4
Updated • 3 -
HF-Quantization/Llama-3.2-1B-BNB-FP4
Updated • 10 -
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
Updated • 1 -
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
Updated • 5 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated • 1 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated -
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
Updated • 14