shawgpt-ft-lr2e-05-wd0.01

README.md

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [TheBloke/Mistral-7B-Instruct-v0.2-GPTQ](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GPTQ) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 3.3804
+- Loss: 3.3666
 
 ## Model description
 
@@ -51,18 +51,18 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch   | Step | Validation Loss |
 |:-------------:|:-------:|:----:|:---------------:|
-| 4.1779        | 0.9231  | 3    | 3.8026          |
-| 4.0882        | 1.8462  | 6    | 3.7331          |
-| 4.0172        | 2.7692  | 9    | 3.6688          |
-| 2.9507        | 4.0     | 13   | 3.5927          |
-| 3.8869        | 4.9231  | 16   | 3.5431          |
-| 3.8087        | 5.8462  | 19   | 3.4996          |
-| 3.768         | 6.7692  | 22   | 3.4629          |
-| 2.7826        | 8.0     | 26   | 3.4239          |
-| 3.6824        | 8.9231  | 29   | 3.4026          |
-| 3.6671        | 9.8462  | 32   | 3.3882          |
-| 3.6579        | 10.7692 | 35   | 3.3812          |
-| 0.8452        | 11.0769 | 36   | 3.3804          |
+| 4.1752        | 0.9231  | 3    | 3.7999          |
+| 4.0826        | 1.8462  | 6    | 3.7282          |
+| 4.0096        | 2.7692  | 9    | 3.6622          |
+| 2.9436        | 4.0     | 13   | 3.5842          |
+| 3.8754        | 4.9231  | 16   | 3.5330          |
+| 3.7962        | 5.8462  | 19   | 3.4884          |
+| 3.7544        | 6.7692  | 22   | 3.4507          |
+| 2.7724        | 8.0     | 26   | 3.4109          |
+| 3.6674        | 8.9231  | 29   | 3.3893          |
+| 3.6522        | 9.8462  | 32   | 3.3749          |
+| 3.643         | 10.7692 | 35   | 3.3674          |
+| 0.8397        | 11.0769 | 36   | 3.3666          |
 
 
 ### Framework versions

runs/Oct22_10-22-42_99867d27916d/events.out.tfevents.1729592563.99867d27916d.882.36

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17133a3e582c3cb5f34b7343735b6e72bb6220874d8ba99c8fdf580a292d365a
+size 11650

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:046196edb25c5e9bded3350424bc9083e2e49b364edae8bb35ab1217ab49f251
+oid sha256:13ef22b8119ccb34b241bf673f09b847800ddcd3a12beda46637754a6f83851e
 size 5240