Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models
Paper
•
2501.11873
•
Published
•
63
Jialong Tang
Jialong
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 1 month ago
Demons in the Detail: On Implementing Load Balancing Loss for Training
Specialized Mixture-of-Expert Models
authored
a paper
about 1 month ago
MinMo: A Multimodal Large Language Model for Seamless Voice Interaction
authored
a paper
7 months ago
Qwen2 Technical Report
Organizations
Jialong's activity
upvoted
a
paper
about 1 month ago
authored
a
paper
about 1 month ago
authored
a
paper
7 months ago