TheBloke
/

Falcon-180B-Chat-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Falcon-180B-Chat-GPTQ / quantize_config.json

Commit History

Set main branch to 4bit-128g-True, sharded

13f6b45

TheBloke commited on Sep 10, 2023

GPTQ model commit

b60d089

TheBloke commited on Sep 6, 2023