gupta-tanish commited on
Commit
1b5f1ef
1 Parent(s): 5e90c73

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -17,4 +17,6 @@ metrics:
17
  tags:
18
  - biology
19
  - chemistry
20
- ---
 
 
 
17
  tags:
18
  - biology
19
  - chemistry
20
+ ---
21
+
22
+ Trained NousResearch/Nous-Hermes-llama-2-7b on UltraFeedback for Direct Preference Optimization on the preference data created on Ultrafeedback having difference b/w chosen score and rejected score>=5