Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies Paper • 2407.13623 • Published Jul 18, 2024 • 57
Sleeping 11 11 Scaling With Vocab Demo 📊 Predict optimal vocabulary size based on model parameters