TheBloke
/

Falcon-180B-Chat-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Falcon-180B-Chat-GPTQ / model.safetensors.index.json

Commit History

Set main branch to 4bit-128g-True, sharded

13f6b45

TheBloke commited on Sep 10, 2023

Add sharded 4-bit GPTQ in place of split files

89eabf0

TheBloke commited on Sep 7, 2023