CCRss
/

Llama-3.1-Nemotron-70B-Instruct-HF-calib-original_pileval_en_AWQ-4bit-g128-gemm

Create README.md

edcff9d verified 2 months ago

106 Bytes

quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }