Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2-57B-A14B-Instruct-GPTQ-Int4
like
22
Follow
Qwen
7.34k
Text Generation
Transformers
Safetensors
English
qwen2_moe
chat
conversational
Inference Endpoints
4-bit precision
gptq
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
vLLM: AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight'. Did you mean: 'qweight'?
6
#1 opened 7 months ago by
geekwish