Shwai He

Shwai's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a collection 2 months ago

LLM-Drop

Collection

Model weights of paper "What Matters in Transformers? Not All Attention is Needed" (https://arxiv.org/abs/2406.15786) • 14 items • Updated Oct 23 • 4

upvoted a paper 2 months ago

What Matters in Transformers? Not All Attention is Needed

Paper • 2406.15786 • Published Jun 22 • 29

upvoted a collection 5 months ago

Papers - MoE

Collection

46 items • Updated 4 days ago • 3

upvoted an article 7 months ago

view article

Article

Merge Large Language Models with mergekit

By •

Jan 9

• 86

upvoted a paper over 1 year ago

AlpaGasus: Training A Better Alpaca with Fewer Data

Paper • 2307.08701 • Published Jul 17, 2023 • 22