psmathur-orca_mini_v2_7b-w4-g128-awq / quantize_config.json
abhinavkulkarni's picture
Upload config
7539924
raw
history blame contribute delete
58 Bytes
{
"bits": 4,
"group_size": 128,
"zero_point": true
}