Minzhi Huang's picture

2 1 1

Minzhi Huang

ChloeHuang1

·

https://github.com/MinzhiHuang?tab=repositories

AI & ML interests

None yet

Recent Activity

new activity 8 days ago

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit:VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

new activity 8 days ago

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ:Can this model use with VLLM?

new activity 9 days ago

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit:VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

View all activity

Organizations

None yet

ChloeHuang1's activity

New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit 8 days ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

#3 opened 10 days ago by

New activity in Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ 8 days ago

Can this model use with VLLM?

#2 opened 8 days ago by

New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit 9 days ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

#3 opened 10 days ago by

New activity in unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit 10 days ago

VLLM with error Blockwise quantization only supports 16/32-bit floats, but got torch.uint8

#3 opened 10 days ago by