Upload README.md
Browse files
README.md
CHANGED
@@ -63,7 +63,7 @@ It is supported by:
|
|
63 |
|
64 |
- [Text Generation Webui](https://github.com/oobabooga/text-generation-webui) - using Loader: AutoAWQ
|
65 |
- [vLLM](https://github.com/vllm-project/vllm) - Llama and Mistral models only
|
66 |
-
- [
|
67 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
|
68 |
|
69 |
<!-- description end -->
|
@@ -326,7 +326,7 @@ The files provided are tested to work with:
|
|
326 |
|
327 |
- [text-generation-webui](https://github.com/oobabooga/text-generation-webui) using `Loader: AutoAWQ`.
|
328 |
- [vLLM](https://github.com/vllm-project/vllm) version 0.2.0 and later.
|
329 |
-
- [
|
330 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) version 0.1.1 and later.
|
331 |
|
332 |
<!-- README_AWQ.md-compatibility end -->
|
|
|
63 |
|
64 |
- [Text Generation Webui](https://github.com/oobabooga/text-generation-webui) - using Loader: AutoAWQ
|
65 |
- [vLLM](https://github.com/vllm-project/vllm) - Llama and Mistral models only
|
66 |
+
- [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference)
|
67 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) - for use from Python code
|
68 |
|
69 |
<!-- description end -->
|
|
|
326 |
|
327 |
- [text-generation-webui](https://github.com/oobabooga/text-generation-webui) using `Loader: AutoAWQ`.
|
328 |
- [vLLM](https://github.com/vllm-project/vllm) version 0.2.0 and later.
|
329 |
+
- [Hugging Face Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) version 1.1.0 and later.
|
330 |
- [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) version 0.1.1 and later.
|
331 |
|
332 |
<!-- README_AWQ.md-compatibility end -->
|