TheBloke
/

Falcon-180B-Chat-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Falcon-180B-Chat-GPTQ / generation_config.json

Commit History

Add sharded 4-bit GPTQ in place of split files

89eabf0

TheBloke commited on Sep 7, 2023

GPTQ model commit

71eb757

TheBloke commited on Sep 6, 2023