Haoze Wu

WaitHZ's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted 2 papers 11 days ago

Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models

Paper • 2501.13629 • Published 11 days ago • 41

Autonomy-of-Experts Models

Paper • 2501.13074 • Published 12 days ago • 40

commented a paper 11 days ago

Autonomy-of-Experts Models

Paper • 2501.13074 • Published 12 days ago • 40 •

5

upvoted 2 papers 5 months ago

Benchmarking Chinese Knowledge Rectification in Large Language Models

Paper • 2409.05806 • Published Sep 9, 2024 • 14

OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs

Paper • 2409.05152 • Published Sep 8, 2024 • 31

upvoted a paper 7 months ago

GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory

Paper • 2406.12375 • Published Jun 18, 2024 • 1

authored a paper 7 months ago

GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory

Paper • 2406.12375 • Published Jun 18, 2024 • 1

upvoted a paper 10 months ago

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2, 2024 • 104

New activity in deepseek-ai/deepseek-moe-16b-base 11 months ago

A little question about aux_loss

2

#4 opened 11 months ago by

WaitHZ

A little question about aux_loss

2

#4 opened 11 months ago by

WaitHZ

A little question about aux_loss

2

#4 opened 11 months ago by

WaitHZ