FlippyDora/step_dpo_mistral_lr1e-7_step200
Updated
•
6
Jiarui Yao
FlippyDora
AI & ML interests
None yet
Recent Activity
updated
a dataset
2 days ago
FlippyDora/orm_qwen25_math
updated
a dataset
2 days ago
FlippyDora/orm_deepseek_math
updated
a dataset
19 days ago
FlippyDora/dpo_pair_data_filtered_length15_ans
Organizations
models
9
FlippyDora/step_dpo_mistral_lr1e-7_step100
Updated
FlippyDora/mdpo
Updated
•
3
FlippyDora/mdpo_guess_cities
Updated
•
7
FlippyDora/dpo-rm-translate
Updated
FlippyDora/gemma-2b-it_lora_r128_lr5e-4_dpo
Updated
FlippyDora/gemma-2b-it_lora_r32_lr5e-4_dpo
Updated
FlippyDora/gemma-2b-it_lora_r16_lr5e-4_dpo
Updated
FlippyDora/gemma-2b-it_lr1e-5_ultrafeedback
Updated
•
1
datasets
26
FlippyDora/orm_qwen25_math
Viewer
•
Updated
•
200k
•
3
FlippyDora/orm_deepseek_math
Viewer
•
Updated
•
200k
•
3
FlippyDora/dpo_pair_data_filtered_length15_ans
Viewer
•
Updated
•
41.2k
•
30
FlippyDora/deepseek_dpo_pair_data_filtered_length15
Viewer
•
Updated
•
25k
•
26
FlippyDora/deepseek_dpo_pair_data_filtered
Viewer
•
Updated
•
29.8k
•
27
FlippyDora/deepseek_dpo_pair_data
Viewer
•
Updated
•
67.1k
•
25
FlippyDora/gsm8k_deepseek_pair_traj_actions_ds
Viewer
•
Updated
•
32.8k
•
79
FlippyDora/math_deepseek_pair_traj_actions_ds
Viewer
•
Updated
•
54.4k
•
56
FlippyDora/dpo_pair_data_filtered_length15
Viewer
•
Updated
•
41.2k
•
79
FlippyDora/dpo_pair_data_traj
Viewer
•
Updated
•
4.28k
•
40