llama-3b-iter-1 / README.md
zhezi12138's picture
Update README.md
cb9e159 verified
metadata
license: mit
datasets:
  - RLHFlow/iterative-prompt-v1-iter1-20K
language:
  - en
base_model:
  - openlm-research/open_llama_3b_v2

This model is for the reproduction of results on Iterative-Prompt dataset of paper "The crucial role of samplers in online direct preference optimization". You can download it and save it as "models/rlhflow_iter1", and then start the training pipeline. Since we've retrained the models, the results may slightly differ from that reported in the paper, and we will update it later.