Mistral-7B-v0.1-GPTQ-4bit-g128 / quantize_config.json

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.1: 4bits, gr128, desc_act=False
50d6f42
verified

iproskurina commited on