Training in progress, epoch 1

README.md

@@ -1,55 +0,0 @@
----
-library_name: transformers
-license: apache-2.0
-base_model: Qwen/Qwen2-0.5B-Instruct
-tags:
-- trl
-- online-dpo
-- generated_from_trainer
-model-index:
-- name: online-dpo-qwen2-2
-  results: []
----
-
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-
-# online-dpo-qwen2-2
-
-This model is a fine-tuned version of [Qwen/Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct) on the trl-lib/ultrafeedback-prompt dataset.
-
-## Model description
-
-More information needed
-
-## Intended uses & limitations
-
-More information needed
-
-## Training and evaluation data
-
-More information needed
-
-## Training procedure
-
-### Training hyperparameters
-
-The following hyperparameters were used during training:
-- learning_rate: 5e-07
-- train_batch_size: 8
-- eval_batch_size: 8
-- seed: 42
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: linear
-- num_epochs: 3.0
-
-### Training results
-
-
-
-### Framework versions
-
-- Transformers 4.45.0.dev0
-- Pytorch 2.4.1+cu121
-- Datasets 3.0.0
-- Tokenizers 0.19.1

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:813e58ddcae94029b2267122bd97306dd4c12aa26cfcb34eadf918e23fe05d61
+oid sha256:444040b9c85172fac0a3f53a2832ab8098ff0841854c638a600dcb57e9311378
 size 1976163472

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:556d6932757de183ac19cc318ac38f3abef5c4e342fd03fefe6c5b411e658ea9
+oid sha256:2379af81492afc25597f2bf5d0dcd8d9b09892ce58fce9cfd1a81098bd41bc98
 size 5432