Adrien ZABBAN

Highdrien's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in PointerHQ/Qwen2.5-VL-72B-Instruct-Pointer-AWQ 2 months ago

Can the AWQ quantized model run on a single A100? I tried to running with vllm on single A100, but failed.

3

#1 opened 2 months ago by

Albertstone