Minzhi Huang

ChloeHuang1's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/QwQ-32B-AWQ 9 days ago

Any one get the issues of <think> tag not showing?

1

#6 opened 9 days ago by

ChloeHuang1

New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit 2 months ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

6

#3 opened 2 months ago by

ChloeHuang1

New activity in Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ 2 months ago

Can this model use with VLLM?

3

#2 opened 2 months ago by

ChloeHuang1

New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit 2 months ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

6

#3 opened 2 months ago by

ChloeHuang1

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

6

#3 opened 2 months ago by

ChloeHuang1