Create README.md

README.md

@@ -0,0 +1,52 @@
+---
+license: mit
+language:
+- en
+pipeline_tag: text-classification
+library_name: fasttext
+tags:
+- code
+---
+
+
+## Code classifier
+
+We use `code-classifier` to retrieve math-related content from `fineweb-edu`, `dclm`, ... to upsample code-related content
+
+
+## Related resources
+
+- [Math classifier](https://huggingface.co/yulan-team/math-classifier)
+- [Code classifier](https://huggingface.co/yulan-team/code-classifier)
+- [Reasoning classifier](https://huggingface.co/yulan-team/reasoning-classifier)
+
+
+---
+
+## Contributing
+
+We welcome any form of contribution, including feedback on model bad cases, feature suggestions, and example contributions. You can do so by submitting an [issue](https://github.com/RUC-GSAI/YuLan-Mini/issues).
+
+## The Team
+
+YuLan-Mini is developed and maintained by [AI Box, Renmin University of China](http://aibox.ruc.edu.cn/).
+
+## License
+
+- The code in this repository, the model weights, and optimizer states are released under the [MIT License](./LICENSE).
+- Policies regarding the use of model weights, intermediate optimizer states, and training data will be announced in future updates.
+- Limitations: Despite our efforts to mitigate safety concerns and encourage the generation of ethical and lawful text, the probabilistic nature of language models may still lead to unexpected outputs. For instance, responses might contain bias, discrimination, or other harmful content. Please refrain from disseminating such content. We are not liable for any consequences arising from the spread of harmful information.
+
+## Citation
+
+If you find YuLan-Mini helpful for your research or development, please cite [our technical report](https://arxiv.org/abs/2412.17743):
+
+
+```
+@article{hu2024yulan,
+  title={YuLan-Mini: An Open Data-efficient Language Model},
+  author={Hu, Yiwen and Song, Huatong and Deng, Jia and Wang, Jiapeng and Chen, Jie and Zhou, Kun and Zhu, Yutao and Jiang, Jinhao and Dong, Zican and Zhao, Wayne Xin and others},
+  journal={arXiv preprint arXiv:2412.17743},
+  year={2024}
+}
+```