Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models
Paper
•
2412.16545
•
Published
ChenlongDeng
ChenlongDeng
AI & ML interests
None yet
Recent Activity
authored
a paper
42 minutes ago
A Silver Bullet or a Compromise for Full Attention? A Comprehensive
Study of Gist Token-based Context Compression
upvoted
a
paper
3 days ago
Large Language Models for Information Retrieval: A Survey
Organizations
None yet
ChenlongDeng's activity
authored
2
papers
42 minutes ago
upvoted
a
paper
3 days ago
upvoted
a
paper
about 2 months ago
updated
a
dataset
4 months ago
如果有新的测试集，可以基于这个模型直接预测吗
2
#1 opened 5 months ago
by
hecongqing
updated
a
model
6 months ago