OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework
Paper
•
2404.14619
•
Published
•
128
Empowering SLMs
Collection of resources focusing on making Small Language Models (SLMs) better at various tasks
-
-
Scaling Laws for Downstream Task Performance of Large Language Models
Paper • 2402.04177 • Published • 19 -
Orca 2: Teaching Small Language Models How to Reason
Paper • 2311.11045 • Published • 75 -
Orca-Math: Unlocking the potential of SLMs in Grade School Math
Paper • 2402.14830 • Published • 26 -
Specialized Language Models with Cheap Inference from Limited Domain Data
Paper • 2402.01093 • Published • 48 -
How to Train Data-Efficient LLMs
Paper • 2402.09668 • Published • 43