Create README.md

README.md

@@ -0,0 +1,32 @@
+---
+license: other
+license_name: microsoft-research-license
+license_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- nlp
+- code
+model-index:
+ - name: phi-2-dpo
+ results:
+ - task:
+ type: text-generation
+ dataset:
+ name: AlpacaEval
+ type: AlpacaEval
+ metrics:
+ - name: AlpacaEval
+ type: AlpacaEval
+ value: 81.37%
+ source:
+ name: AlpacaEval
+ url: https://github.com/tatsu-lab/alpaca_eval
+---
+
+## Model Summary
+
+`phi-2-dpo` is an instruction-tuned model from an earlier SFT model [`phi-2-sft`](https://huggingface.co/lxuechen/phi-2-sft). Direct preference optimization (DPO) is used for fine-tuning on the [UltraFeedback dataset](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized)
+
+The purpose of the experiment is to understand the quality of the pre-trained Phi-2 model. The good news is that `phi-2-dpo` can follow open-ended user instructions well.