Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2-VL-72B-Instruct-GPTQ-Int4
like
16
Follow
Qwen
7.27k
Image-Text-to-Text
Safetensors
English
qwen2_vl
multimodal
conversational
4-bit precision
gptq
arxiv:
2409.12191
arxiv:
2308.12966
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
1
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Any one can use VLLM or any other engine support dynamic batch to run this with more than 1 GPU?
1
#1 opened 3 months ago by
bash99
