TheBloke
/

Falcon-180B-Chat-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Sep 7, 2023

Commit

2e0f5aa

•

1 Parent(s): 229b765

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -53,7 +53,8 @@ But they work great direct from Transformers!
 Currently these GPTQs are tested to work with:
 - Transformers 4.33.0
-- Text Generation Inference (TGI) 1.0.2
 <!-- description end -->

 Currently these GPTQs are tested to work with:
 - Transformers 4.33.0
+- [Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) version 1.0.4
+  - Docker container: `ghcr.io/huggingface/text-generation-inference:latest`
 <!-- description end -->