Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks
Paper
• 2309.17002 • Published
• 1
Synthetic Data for Large Language Models
non-profit
AI & ML interests
Exploring the diversity in synthetic data for pretraining large (and smol) language models.