Zheng Han

traphix's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in RedHatAI/DeepSeek-R1-quantized.w4a16 3 days ago

Does vllm 0.8.4 support this quantized model?

#1 opened 3 days ago by

traphix

New activity in Qwen/QwQ-32B about 1 month ago

This model beats Qwen Max!

1

7

#33 opened about 2 months ago by

MrDevolver

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 2 months ago

why "MLA is not supported with awq_marlin quantization. Disabling MLA." with 4090 * 32 (4 node / vllm 0.7.2)

1

3

#14 opened about 2 months ago by

FightLLM

Is there any accuracy results comparing to original DeepSeek-R1？

2

#15 opened about 2 months ago by

traphix

New activity in cognitivecomputations/DeepSeek-R1-AWQ 2 months ago

Has anyone evaluated the performance of the AWQ version of the model on benchmarks?

4

#8 opened 2 months ago by

liuqianchao

skips the thinking process

11

#5 opened 2 months ago by

muzizon

Deployment framework

27

#2 opened 3 months ago by

xro7

New activity in cognitivecomputations/DeepSeek-V3-AWQ 2 months ago

vllm support a100

17

#2 opened 3 months ago by

HuggingLianWang

New activity in RedHatAI/DeepSeek-Coder-V2-Instruct-FP8 8 months ago

Can it run on A100/A800 with VLLM?

3

#1 opened 9 months ago by

Parkerlambert123

liked a model 8 months ago

RedHatAI/DeepSeek-Coder-V2-Instruct-FP8

Text Generation • Updated Jul 22, 2024 • 586 • 7

upvoted a collection 8 months ago

INT8 LLMs for vLLM

Collection

Accurate INT8 quantized models by Neural Magic, ready for use with vLLM! • 50 items • Updated Sep 26, 2024 • 15