Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
Paper
•
2502.11089
•
Published
•
138
Ersi Ni
nilbot
·
AI & ML interests
Transformers
Recent Activity
updated
a collection
13 days ago
towards AGI
upvoted
a
paper
13 days ago
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse
Attention
upvoted
an
article
26 days ago
G2P Shrinks Speech Models
Organizations
None yet
nilbot's activity
upvoted
a
paper
13 days ago
upvoted
an
article
26 days ago
Article
G2P Shrinks Speech Models
By
•
•
33
upvoted
a
paper
about 1 month ago
upvoted
an
article
about 1 month ago
Article
MiniMax-01 is Now Open-Source: Scaling Lightning Attention for the AI Agent Era
By
•
•
42
upvoted
an
article
about 2 months ago
Article
🌁#82: AI and ML in Real Life
By
•
•
16
upvoted
a
paper
3 months ago
upvoted
an
article
6 months ago
Article
GaLore: Advancing Large Model Training on Consumer-grade Hardware
•
27
upvoted
a
collection
6 months ago
upvoted
a
paper
10 months ago
upvoted
an
article
10 months ago
Article
Fine-tune Llama 3 with ORPO
By
•
•
234
upvoted
a
collection
11 months ago
upvoted
a
paper
about 1 year ago