Selective Attention Improves Transformer
Paper
•
2410.02703
•
Published
•
23
Attention
-
-
Differential Transformer
Paper • 2410.05258 • Published • 168 -
TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
Paper • 2410.05076 • Published • 7 -
SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
Paper • 2410.13276 • Published • 25 -
Star Attention: Efficient LLM Inference over Long Sequences
Paper • 2411.17116 • Published • 47 -
KV Shifting Attention Enhances Language Modeling
Paper • 2411.19574 • Published • 8