TheBloke
/

Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

the model is supported by TGI

#19

by MoritzLaurer HF staff - opened Jun 26, 2024

base: refs/heads/main

←

from: refs/pr/19

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -242,7 +242,7 @@ It is strongly recommended to use the text-generation-webui one-click-installers
 <!-- README_GPTQ.md-use-from-tgi start -->
 ## Serving this model from Text Generation Inference (TGI)
-Not currently supported for Mixtral models.
 <!-- README_GPTQ.md-use-from-tgi end -->
 <!-- README_GPTQ.md-use-from-python start -->

 <!-- README_GPTQ.md-use-from-tgi start -->
 ## Serving this model from Text Generation Inference (TGI)
+The model is supported by [TGI](https://huggingface.co/docs/text-generation-inference/supported_models)
 <!-- README_GPTQ.md-use-from-tgi end -->
 <!-- README_GPTQ.md-use-from-python start -->