HandH1998's picture

13 1

HandH1998

HandH1998

·

HandH1998

AI & ML interests

None yet

Recent Activity

updated a model 27 days ago

HandH1998/DeepSeek-R1-QQQ-channel

published a model 27 days ago

HandH1998/DeepSeek-R1-QQQ-channel

updated a model 27 days ago

HandH1998/DeepSeek-R1-QQQ-g128

View all activity

Organizations

HandH1998's activity

New activity in meituan/DeepSeek-R1-Block-INT8 about 1 month ago

After deploying with the latest sglang, I found that the responses when calling the interface were chaotic.

#13 opened about 2 months ago by

New activity in meituan/DeepSeek-R1-Block-INT8 about 2 months ago

是否有明确的sglang镜像版本推荐：）

#14 opened about 2 months ago by

New activity in meituan/DeepSeek-R1-Channel-INT8 about 2 months ago

Add `quantization_config` in config.json?

#4 opened about 2 months ago by

运行channel INT8后sglang报错OOM

#3 opened about 2 months ago by

New activity in meituan/DeepSeek-R1-Block-INT8 about 2 months ago

量化类型

#11 opened about 2 months ago by

New activity in meituan/DeepSeek-R1-Channel-INT8 about 2 months ago

Difference with Block-wise Int8?

#1 opened about 2 months ago by

New activity in meituan/DeepSeek-R1-Block-INT8 about 2 months ago

Why hasn't the model file size changed?

#9 opened about 2 months ago by

New activity in cognitivecomputations/DeepSeek-V3-AWQ 2 months ago

What calibration dataset do you use when applying AWQ?

#5 opened 2 months ago by