Hugging Face's logo
amang1802 's Collections
Small model pretraining experiments
PPO experiments
Synthetic Data rewrite (model checkpoints)
Synthetic Data rewrite research (training and eval datasets)
WildeWeb Research

Synthetic Data rewrite research (training and eval datasets)

Researching methods for synthetic rewrites for CPT datasets and evaluating them in their ability to improve knowledge memorization

Upvote
-