Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Paper
•
2501.13629
•
Published
•
39
huxueyu
huxueyu
AI & ML interests
Large Language Models
Recent Activity
upvoted
a
paper
3 days ago
Sigma: Differential Rescaling of Query, Key and Value for Efficient
Language Models
authored
a paper
17 days ago
Fine-Grained Guidance for Retrievers: Leveraging LLMs' Feedback in
Retrieval-Augmented Generation
authored
a paper
17 days ago
One Model, Multiple Modalities: A Sparsely Activated Approach for Text,
Sound, Image, Video and Code
Organizations
