Qwen
/

Qwen2-7B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Qwen2-7B-Instruct-GPTQ-Int8 / generation_config.json

Commit History

add generation_config.json

06d7f7d

feihu.hf commited on Jun 6