File size: 698 Bytes
c3f5ce7 c9bbb63 c3f5ce7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
license: apache-2.0
language:
- en
base_model:
- meta-llama/Llama-2-7b-hf
datasets:
- tatsu-lab/alpaca_farm
pipeline_tag: text-generation
---
This is the backbone SFT model used in the paper "[DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging](https://arxiv.org/abs/2407.01470)".
For the detailed information about this model, please refer to our paper.
If you found this model useful, please cite our paper:
```
@article{lin2024dogerm,
title={DogeRM: Equipping Reward Models with Domain Knowledge through Model Merging},
author={Lin, Tzu-Han and Li, Chen-An and Lee, Hung-yi and Chen, Yun-Nung},
journal={arXiv preprint arXiv:2407.01470},
year={2024}
}
``` |