File size: 421 Bytes
5a2db8d |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
---
license: apache-2.0
datasets:
- opencsg/UltraFeedback-chinese
language:
- zh
base_model:
- opencsg/csg-wukong-smoltalk-chinese
---
* We apply DPO to ``opencsg/csg-wukong-2b-smoltalk-chinese``, using ``ultrafeedback-chinese-binarized-lowest`` as the DPO dataset.
* Train 2 epochs, learning rate=5e-6, batchsize=128
* This model's evaluation score is higher than that one trained on ``ultrafeedback-chinese-binarized`` |