Hugging Face's logo

AmalNlal
/
my_awesome_eli5_mlm_model

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
AmalNlal commited on
Commit
b0c5b51
•
1 Parent(s): 726be8b

End of training

Browse files
Files changed (10) hide show
  1. README.md +5 -7
  2. model.safetensors +1 -1
  3. runs/May01_15-39-39_Amal/events.out.tfevents.1714570780.Amal.31556.2 +3 -0
  4. runs/May01_15-42-40_Amal/events.out.tfevents.1714570961.Amal.31556.3 +3 -0
  5. runs/May01_15-44-12_Amal/events.out.tfevents.1714571052.Amal.31556.4 +3 -0
  6. runs/May01_15-45-45_Amal/events.out.tfevents.1714571146.Amal.31556.5 +3 -0
  7. runs/May01_15-47-02_Amal/events.out.tfevents.1714571222.Amal.31556.6 +3 -0
  8. runs/May01_15-48-06_Amal/events.out.tfevents.1714571286.Amal.31556.7 +3 -0
  9. runs/May01_15-48-06_Amal/events.out.tfevents.1714585552.Amal.31556.8 +3 -0
  10. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [distilbert/distilroberta-base](https://huggingface.co/distilbert/distilroberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.0260
19
 
20
  ## Model description
21
 
@@ -34,21 +34,19 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
- - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 2.2634 | 1.0 | 1305 | 2.0517 |
50
- | 2.1672 | 2.0 | 2610 | 2.0327 |
51
- | 2.1388 | 3.0 | 3915 | 2.0124 |
52
 
53
 
54
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [distilbert/distilroberta-base](https://huggingface.co/distilbert/distilroberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.7764
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 7e-06
38
+ - train_batch_size: 4
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 1
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 0.8608 | 1.0 | 6504 | 0.7782 |
 
 
50
 
51
 
52
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ba019269775baf0241755760ee10123eb9abb113a00940390ecf0cab994ade6c
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ab1d0c022ada85974a76c833812b627f152cb9c2ab277b70f2ee2839482772b
3
  size 328693404
runs/May01_15-39-39_Amal/events.out.tfevents.1714570780.Amal.31556.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a581e7407a97b433f0e7b378b165677f932e4555def6a8052ad613d5024554e2
3
+ size 4339
runs/May01_15-42-40_Amal/events.out.tfevents.1714570961.Amal.31556.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:577263c0713a5ea2b06ac6d1528af2fe741a284b651c4a9175d0822f545c63f4
3
+ size 4339
runs/May01_15-44-12_Amal/events.out.tfevents.1714571052.Amal.31556.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0daf81ebc2a847003061458980549ae3af8bb9dba41cd1dfaaeeca42710f499f
3
+ size 4340
runs/May01_15-45-45_Amal/events.out.tfevents.1714571146.Amal.31556.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8fafff30c14389dcd56a9cf0a308ffe808abfca65f541f5f63b286a9467e2c56
3
+ size 4340
runs/May01_15-47-02_Amal/events.out.tfevents.1714571222.Amal.31556.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abd0544a510aaea8e72e22f4dcdf07a37a2ed77cfbcacb01dd3378bc4ffc00bb
3
+ size 4340
runs/May01_15-48-06_Amal/events.out.tfevents.1714571286.Amal.31556.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cc5e9827d963be5e3ef29dc54a4a11511c96b466e96cc07ab8bf1acecea38b9
3
+ size 7006
runs/May01_15-48-06_Amal/events.out.tfevents.1714585552.Amal.31556.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17d7498d2ac784e2beb11912ab5af1aee9a02c250cb2c43ef2cb70b2f47b1568
3
+ size 311
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:449d7be9997fd02cc54869aec6da420077c8588f09117d416bbb24263ae21ed2
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3e02d5965902ba53c65fcdb18750eba193415f203be009fae744f8e118f9772
3
  size 4728