ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
Paper
•
2412.14711
•
Published
•
15
•
2
Jintao Zhang
jt-zhang
AI & ML interests
Efficient ML
Recent Activity
upvoted
a
paper
20 days ago
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
commented
a paper
20 days ago
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing
commented
a paper
25 days ago
SageAttention2 Technical Report: Accurate 4 Bit Attention for
Plug-and-play Inference Acceleration
Organizations
None yet
jt-zhang's activity
commented
a
paper
20 days ago
commented
3
papers
25 days ago
SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration
Paper
•
2411.10958
•
Published
•
52
•
9
SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration
Paper
•
2411.10958
•
Published
•
52
•
9
SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration
Paper
•
2411.10958
•
Published
•
52
•
9
commented
2
papers
about 2 months ago