What Matters in Transformers? Not All Attention is Needed
Paper
•
2406.15786
•
Published
•
32
•
3
Eni Grand
Enigrand
fibrosis's profile picture
21world's profile picture
b082f689-ebc3-413d-b1f2-27bd1e86dca7's profile picture
·
AI & ML interests
None yet
Recent Activity
liked
a model
3 days ago
nvidia/Llama-3.1-8B-UltraLong-1M-Instruct
upvoted
a
collection
4 days ago
InternVL3
upvoted
a
paper
5 days ago
Kimi-VL Technical Report
Organizations
Enigrand's activity
It's been a wild ride, folks :) (end of the Open LLM Leaderboard)
81
19
#1135 opened about 1 month ago
by
clefourrier
Qwen2.5-32B merge eval error
3
5
#1078 opened 3 months ago
by
ehristoforu
commented
a
paper
6 months ago
If you find Independent third-party evaluation results about this model, please share here.
1
7
#42 opened 7 months ago
by
Enigrand
Hi, can you deal with the bot spamming the community section of mattshumer/ref_70_e3 and
6
#16 opened 7 months ago
by
Enigrand
🚩 Report
3
17
#6 opened 7 months ago
by
gileneo
Reflection-Llama-3.1-70B was sonnet 3.5.
6
#5 opened 7 months ago
by
Enigrand
mattshumer/ref_70_e3 and mattshumer/Reflection-Llama-3.1-70B-ep2-working are the SAME.
4
2
#10 opened 7 months ago
by
Enigrand
Third party evaluation on this so-called "LLM".
3
#7 opened 7 months ago
by
Enigrand
Reflection-Llama-3.1-70B was claude 3, chatgpt4o and what?
7
1
#48 opened 7 months ago
by
Enigrand
[Question] 2B or 5B?
2
#1 opened 8 months ago
by
Enigrand
[MODELS] Discussion
34
715
#372 opened about 1 year ago
by
victor
How to FP8 inference
5
2
#5 opened 9 months ago
by
alfredplpl
Questions about the context length
2
#4 opened 10 months ago
by
Enigrand