Jian Liao

imjliao's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in PointerHQ/Qwen2.5-VL-72B-Instruct-Pointer-AWQ about 2 months ago

Can the AWQ quantized model run on a single A100? I tried to running with vllm on single A100, but failed.

3

#1 opened 2 months ago by

Albertstone

New activity in Benasd/Qwen2.5-VL-72B-Instruct-AWQ about 2 months ago

failed with 4 gpu

3

#2 opened about 2 months ago by

asarray

New activity in Qwen/Qwen2.5-VL-72B-Instruct-AWQ about 2 months ago

Lanuch model with vllm --tensor-parallel (Error: input_size_per_partition not divisible by min_thread_k)

8

#2 opened about 2 months ago by

prstg

New activity in Benasd/Qwen2.5-VL-7B-Instruct-AWQ 2 months ago

72B AWQ Quantization

#1 opened 2 months ago by

imjliao

New activity in bytedance-research/UI-TARS 2 months ago

Which model is the demo running?

5

#1 opened 3 months ago by

iitzco

New activity in tanbw/CosyVoice 6 months ago

无法选择Instruct模型

#1 opened 6 months ago by

imjliao

commented a paper over 1 year ago

Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts

Paper • 2309.07430 • Published Sep 14, 2023 • 27 •

4