End of training

README.md

@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6329
-- Eval/rewards/chosen: 0.4406
-- Eval/logps/chosen: -199.1299
-- Eval/rewards/rejected: 0.4160
-- Eval/logps/rejected: -211.0515
-- Eval/rewards/margins: 0.0246
-- Eval/kl: 4.1837
+- Loss: 1.1345
+- Eval/rewards/chosen: 4.0853
+- Eval/logps/chosen: -162.6833
+- Eval/rewards/rejected: 4.3450
+- Eval/logps/rejected: -171.7619
+- Eval/rewards/margins: -0.2597
+- Eval/kl: 37.7215
 
 ## Model description
 
@@ -43,7 +43,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 1e-05
+- learning_rate: 0.0001
 - train_batch_size: 1
 - eval_batch_size: 2
 - seed: 5678
@@ -56,14 +56,14 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |        |
-|:-------------:|:-----:|:----:|:---------------:|:------:|
-| 0.5565        | 0.96  | 12   | 0.6326          | 0.3559 |
-| 0.6102        | 2.0   | 25   | 0.6329          | 1.4255 |
-| 0.5449        | 2.96  | 37   | 0.6345          | 2.7750 |
-| 0.6022        | 4.0   | 50   | 0.6340          | 3.7858 |
-| 0.5433        | 4.96  | 62   | 0.6299          | 4.1605 |
-| 0.5345        | 5.76  | 72   | 0.6329          | 4.1837 |
+| Training Loss | Epoch | Step | Validation Loss |         |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|
+| 0.6644        | 0.96  | 12   | 0.8564          | 0.0143  |
+| 0.7117        | 2.0   | 25   | 1.0975          | 20.1969 |
+| 0.3864        | 2.96  | 37   | 1.1568          | 33.5785 |
+| 0.4414        | 4.0   | 50   | 1.1371          | 34.2847 |
+| 0.347         | 4.96  | 62   | 1.1333          | 37.5375 |
+| 0.3002        | 5.76  | 72   | 1.1345          | 37.7215 |
 
 
 ### Framework versions

adapter_config.json

@@ -20,10 +20,10 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
+    "o_proj",
     "q_proj",
     "k_proj",
-    "o_proj"
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3dd591cc2f02afedb7aff8f59694291964f5cd8e3a725f077720a3dd67b1a56d
+oid sha256:25fb1e85f3783f19cfdf18c575d3196fb7e5ff9247059a148562a454bb36a9f5
 size 27297544

metrics.jsonl

@@ -70,3 +70,9 @@
 {"epoch": 4.0, "precision": 0.3673469380258226, "recall": 0.9999999944444444, "fold": 0}
 {"epoch": 4.96, "precision": 0.3617021268899955, "recall": 0.9444444391975308, "fold": 0}
 {"epoch": 5.76, "precision": 0.33999999931999997, "recall": 0.9444444391975308, "fold": 0}
+{"epoch": 0.96, "precision": 0.4999999984375, "recall": 0.8888888839506173, "fold": 0}
+{"epoch": 2.0, "precision": 0.5333333315555555, "recall": 0.8888888839506173, "fold": 0}
+{"epoch": 2.96, "precision": 0.6799999972799999, "recall": 0.9444444391975308, "fold": 0}
+{"epoch": 4.0, "precision": 0.6999999965, "recall": 0.7777777734567901, "fold": 0}
+{"epoch": 4.96, "precision": 0.5999999976, "recall": 0.8333333287037037, "fold": 0}
+{"epoch": 5.76, "precision": 0.6799999972799999, "recall": 0.9444444391975308, "fold": 0}

metrics_epoch_0.96_fold_0_lr_0.0001_seed_5678_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 0.96, "precision": 0.4999999984375, "recall": 0.8888888839506173, "fold": 0}

metrics_epoch_2.0_fold_0_lr_0.0001_seed_5678_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 2.0, "precision": 0.5333333315555555, "recall": 0.8888888839506173, "fold": 0}

metrics_epoch_2.96_fold_0_lr_0.0001_seed_5678_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 2.96, "precision": 0.6799999972799999, "recall": 0.9444444391975308, "fold": 0}

metrics_epoch_4.0_fold_0_lr_0.0001_seed_5678_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 4.0, "precision": 0.6999999965, "recall": 0.7777777734567901, "fold": 0}

metrics_epoch_4.96_fold_0_lr_0.0001_seed_5678_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 4.96, "precision": 0.5999999976, "recall": 0.8333333287037037, "fold": 0}

metrics_epoch_5.76_fold_0_lr_0.0001_seed_5678_weight_5.0.json

@@ -0,0 +1 @@
+{"epoch": 5.76, "precision": 0.6799999972799999, "recall": 0.9444444391975308, "fold": 0}

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2803958bc9902aecb85baabef1bfd3edaaaace9da9f997204d7dad9c8e16a590
+oid sha256:6947aa77e83d5bc53e9c13d61abccbd998cdcb09a4da2bc29364f223286e7a23
 size 5688