End of training

README.md

@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.9469
-- Matthews Correlation: 0.5245
+- Loss: 0.6055
+- Matthews Correlation: 0.5321
 
 ## Model description
 
@@ -37,26 +37,28 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2.01437918768118e-05
-- train_batch_size: 4
+- learning_rate: 2e-05
+- train_batch_size: 16
 - eval_batch_size: 16
-- seed: 9
+- seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 3
+- num_epochs: 5
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Matthews Correlation |
 |:-------------:|:-----:|:----:|:---------------:|:--------------------:|
-| 0.5529        | 1.0   | 2138 | 0.4856          | 0.4792               |
-| 0.4354        | 2.0   | 4276 | 0.7809          | 0.4759               |
-| 0.281         | 3.0   | 6414 | 0.9469          | 0.5245               |
+| 0.5174        | 1.0   | 535  | 0.4610          | 0.4584               |
+| 0.342         | 2.0   | 1070 | 0.4699          | 0.5176               |
+| 0.2337        | 3.0   | 1605 | 0.6055          | 0.5321               |
+| 0.1728        | 4.0   | 2140 | 0.8054          | 0.5087               |
+| 0.1264        | 5.0   | 2675 | 0.8455          | 0.5193               |
 
 
 ### Framework versions
 
-- Transformers 4.38.2
-- Pytorch 2.2.1+cu121
-- Datasets 2.18.0
-- Tokenizers 0.15.2
+- Transformers 4.44.0
+- Pytorch 2.3.1+cu121
+- Datasets 2.20.0
+- Tokenizers 0.19.1

config.json

@@ -20,6 +20,6 @@
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
   "torch_dtype": "float32",
-  "transformers_version": "4.38.2",
+  "transformers_version": "4.44.0",
   "vocab_size": 30522
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4b60f5d2c0ab42107b330cf0bb13ccc15f664fa6dc3f068acb29f8e2d6243080
+oid sha256:fd3974a6be1ee0c2cdd4944b633fddd6a4a6aa98c3bc293f6471e51a09383c27
 size 267832560

runs/Aug12_13-09-40_fe37024e1c53/events.out.tfevents.1723468252.fe37024e1c53.394.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0e7671272da46bbdf0cde3116eefd24f18e71e81bab47792d246ed1e3da771a
+size 7953

runs/Aug12_13-09-40_fe37024e1c53/events.out.tfevents.1723468437.fe37024e1c53.394.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b913f1faafb31f639e96d4f908669b37b3cadfb7e79911c470a21ca180260b7a
+size 423

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a1c579802743ec5bde7ffe4a1b22c8900fae6cd071e374192c2957c3eec29367
-size 4984
+oid sha256:bbf8a22059d35d4b025dd83b6e5311ba5323c678139142cfb818b1d3c59b1aff
+size 5240