HuggingFaceM4
/

idefics2-8b

Image-Text-to-Text

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

VictorSanh commited on Apr 16

Commit

6e13295

•

1 Parent(s): 2c25217

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -247,7 +247,7 @@ Flash attention 2 support is available both for `idefics2-8b-base` and `idefics2
 <details><summary>Click to expand.</summary>
-4-bit AWQ-quantized versions of the checkpoints are also available and allow module fusing for accelerated inference. First make sure you install the Auto-AWQ library with `pip install autoawq`. Also make sure that this [fix] is integrated into your installation.
 ```diff
 + from transformers import AwqConfig

 <details><summary>Click to expand.</summary>
+4-bit AWQ-quantized versions of the checkpoints are also available and allow module fusing for accelerated inference. First make sure you install the Auto-AWQ library with `pip install autoawq`. Also make sure that this [fix](https://github.com/casper-hansen/AutoAWQ/pull/444) is integrated into your installation.
 ```diff
 + from transformers import AwqConfig