Steel-LLM:From Scratch to Open Source -- A Personal Journey in Building a Chinese-Centric LLM
Paper
•
2502.06635
•
Published
•
4
LLM
-
-
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Paper • 2502.02737 • Published • 215 -
REINFORCE++: A Simple and Efficient Approach for Aligning Large Language Models
Paper • 2501.03262 • Published • 98 -
MiniMax-01: Scaling Foundation Models with Lightning Attention
Paper • 2501.08313 • Published • 282 -
Towards Best Practices for Open Datasets for LLM Training
Paper • 2501.08365 • Published • 60 -
Qwen2.5-1M Technical Report
Paper • 2501.15383 • Published • 68 -
LLM Pretraining with Continuous Concepts
Paper • 2502.08524 • Published • 28 -
Predictive Data Selection: The Data That Predicts Is the Data That Teaches
Paper • 2503.00808 • Published • 56 -
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs
Paper • 2503.01743 • Published • 79 -
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Paper • 2503.14456 • Published • 131 -
A Comprehensive Survey on Long Context Language Modeling
Paper • 2503.17407 • Published • 47 -
Gemma 3 Technical Report
Paper • 2503.19786 • Published • 40