Anmol Reddy

molereddy's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 27 days ago

Poorer performance than W8A8

#6 opened 27 days ago by

molereddy

New activity in CalamitousFelicitousness/Qwen2.5-0.5B-Instruct-fp8-dynamic about 1 month ago

How was the quantization performed - do you have a recipe?

#1 opened about 1 month ago by

molereddy

New activity in neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 about 2 months ago

Is this the standard GPTQ quantization?

1

#5 opened about 2 months ago by

molereddy

New activity in neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 about 2 months ago

Model weights are not loaded

4

#3 opened 4 months ago by

MarvelousMouse