high-quality Chinese training datasets
Collection
a suite of high-quality Chinese datasets, used for pretraining, fine-tuning or reinforcement learning.
•
9 items
•
Updated
•
3
- Using
opencsg/csg-wukong-2b-chinese-fineweb-eduas base model, we fine-tune it onsmoltalk-chinesefor 2 epoch - learning rate = 3e-4 ; global batch size = 32 ; lr scheduler=cosine
- Downloads last month
- 15