CLASS-MATE
/

BERT-MLM

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

AmalNlal commited on Mar 22, 2024

Commit

b83e5ee

·

verified ·

1 Parent(s): 0226812

End of training

Files changed (1) hide show

README.md +7 -7

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 7.9301
 ## Model description
@@ -32,7 +32,7 @@ More information needed
 ### Training hyperparameters
 The following hyperparameters were used during training:
-- learning_rate: 0.01
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
@@ -44,11 +44,11 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 9.2035        | 0.06  | 100  | 8.1180          |
-| 8.0969        | 0.12  | 200  | 8.0501          |
-| 8.002         | 0.19  | 300  | 8.0142          |
-| 8.0026        | 0.25  | 400  | 7.9677          |
-| 7.9075        | 0.31  | 500  | 7.9301          |
 ### Framework versions

 This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
 It achieves the following results on the evaluation set:
+- Loss: 7.9694
 ## Model description
 ### Training hyperparameters
 The following hyperparameters were used during training:
+- learning_rate: 0.1
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
+| 14.7772       | 0.06  | 100  | 8.6683          |
+| 9.1925        | 0.12  | 200  | 9.1429          |
+| 8.6946        | 0.19  | 300  | 10.0975         |
+| 8.3986        | 0.25  | 400  | 8.3313          |
+| 8.0251        | 0.31  | 500  | 7.9694          |
 ### Framework versions