Model save

README.md

@@ -1,7 +1,7 @@
 ---
 base_model: RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter3
 library_name: transformers
-model_name: self-correct_mistral-small-it_mMQA_dpo_iter4
+model_name: self-correct_mistral-small-it_mMQA_dpo_iter4_beta.05
 tags:
 - generated_from_trainer
 - trl
@@ -9,7 +9,7 @@ tags:
 licence: license
 ---
 
-# Model Card for self-correct_mistral-small-it_mMQA_dpo_iter4
+# Model Card for self-correct_mistral-small-it_mMQA_dpo_iter4_beta.05
 
 This model is a fine-tuned version of [RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter3](https://huggingface.co/RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter3).
 It has been trained using [TRL](https://github.com/huggingface/trl).
@@ -20,14 +20,14 @@ It has been trained using [TRL](https://github.com/huggingface/trl).
 from transformers import pipeline
 
 question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
-generator = pipeline("text-generation", model="RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter4", device="cuda")
+generator = pipeline("text-generation", model="RyanYr/self-correct_mistral-small-it_mMQA_dpo_iter4_beta.05", device="cuda")
 output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
 print(output["generated_text"])
 ```
 
 ## Training procedure
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/7r6eu01x)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/9v4u4jit)
 
 This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
 

last_checkpoint/model-00001-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:62c407fffc3fbaa766d3fc59a0b63e6bc8fb71fa08da6305f682aa3b5c0740d3
+oid sha256:1ce56c04a7874e4526e2fe334e4daf76de4ad4906910397d6fda4723edc26bfe
 size 4882311064

last_checkpoint/model-00002-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:332de79d621c1bfaf1a6abcae167840ee9f04162d816adeb0554958941d6a347
+oid sha256:9ad99d58e44f3950c541a7a3e2124abe73ba2d8826d1a36bbe9f10bfec485c5b
 size 4983012160

last_checkpoint/model-00003-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1fe416ce237a1aaabdc76a461a9cf8c5e5b5e3fd947c3d8d289da58d9dae446e
+oid sha256:543c30a9770268d5a83da5933f180d5615de61a6bd5d0ef06890c6147d8a8ef1
 size 4957821336

last_checkpoint/model-00004-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:df0596118c13451959c1e9575da3306cbfb5f183d8022c2b2938f535b7e21a4c
+oid sha256:7e9840f56194de65753cc5d1e17180dc43372a31ea362cc4057c34e760e6bb7c
 size 4882323744

last_checkpoint/model-00005-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a372d7fb81977a147ca6436772c1e52099785b4e3add9f17b339c33d3dd0eb5e
+oid sha256:eaa6b08c20bbe768ad0f203937bab37fe7086311c0393f8b0d099c0c0f887a2f
 size 4983012192

last_checkpoint/model-00006-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e5f8e23448a16360d709567b476504640ae6f7a6dd5034691cd7a185c838bf27
+oid sha256:3c0e9207ab4ec54ff3ebf34b298c28813088ce536132cc7be47ff3c6a31fd0b1
 size 4957821336

last_checkpoint/model-00007-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b4f757792f1c02edc7d6d6bc9f17cd381e48a4c0146d7d83a80d5ecab37bcfed
+oid sha256:f40eb60bb55571888feca2ddd30ed90b3a27ed4a248de8c2be7017bd07bdd756
 size 4882323744

last_checkpoint/model-00008-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:07cf7d37851c5ee893ecceb35b990079aabdc3040a48780eb91af9bed662c897
+oid sha256:226801c226c219a40e695b7e5e84dc1e9f08cfb4e2606985242701b407201bb7
 size 4983012192

last_checkpoint/model-00009-of-00009.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:85415011c32e780c0c42063d67350502afa3328db3ae9ec68476f396adbcf635
+oid sha256:b700e6a9059e61d84fcf2dd67269a79cc94869a9d1eb9ee5a656ebe3a228b878
 size 4983011344

last_checkpoint/training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cc45a21acfb2b3090718ebf7468c7cf154f3191f9e8b8b7d1c8717ab27a618c6
-size 7992
+oid sha256:54d262dbc7511ad28b68a59cbd7ca46588a94f311178792d0cee28854ba7d066
+size 8056