| library_name: transformers | |
| tags: [] | |
| This is the SFT checkpoint used for the project [Online-RLHF](https://github.com/RLHFlow/Online-RLHF). Also check our [technical report here](https://arxiv.org/pdf/2405.07863). | |
| The model is trained on a mixture of diverse open-source high-quality data for 1 epoch with detailed parameters in the report. It has not been trained by RLHF and can serve as a good starting point for the RLHF research. | |