lukeleeai commited on
Commit
83e2488
1 Parent(s): 8b41eed

End of training

Browse files
Files changed (4) hide show
  1. README.md +9 -10
  2. pytorch_model.bin +2 -2
  3. spiece.model +3 -0
  4. training_args.bin +2 -2
README.md CHANGED
@@ -22,7 +22,7 @@ model-index:
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
- value: 0.8111217641418984
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,8 +32,8 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [t5-base](https://huggingface.co/t5-base) on the glue dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 0.4951
36
- - Accuracy: 0.8111
37
 
38
  ## Model description
39
 
@@ -56,6 +56,8 @@ The following hyperparameters were used during training:
56
  - train_batch_size: 32
57
  - eval_batch_size: 64
58
  - seed: 0
 
 
59
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
  - lr_scheduler_type: linear
61
  - lr_scheduler_warmup_steps: 20
@@ -65,16 +67,13 @@ The following hyperparameters were used during training:
65
 
66
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
67
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
68
- | 0.576 | 0.19 | 50 | 0.6161 | 0.6913 |
69
- | 0.4767 | 0.37 | 100 | 0.5660 | 0.7641 |
70
- | 0.5155 | 0.56 | 150 | 0.4750 | 0.7996 |
71
- | 0.3959 | 0.75 | 200 | 0.4754 | 0.7996 |
72
- | 0.4453 | 0.93 | 250 | 0.4903 | 0.8111 |
73
 
74
 
75
  ### Framework versions
76
 
77
  - Transformers 4.34.1
78
- - Pytorch 2.1.0+cu118
79
- - Datasets 2.14.6
80
  - Tokenizers 0.14.1
 
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
+ value: 0.7976989453499521
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
32
 
33
  This model is a fine-tuned version of [t5-base](https://huggingface.co/t5-base) on the glue dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 0.4850
36
+ - Accuracy: 0.7977
37
 
38
  ## Model description
39
 
 
56
  - train_batch_size: 32
57
  - eval_batch_size: 64
58
  - seed: 0
59
+ - gradient_accumulation_steps: 2
60
+ - total_train_batch_size: 64
61
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
62
  - lr_scheduler_type: linear
63
  - lr_scheduler_warmup_steps: 20
 
67
 
68
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
69
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
70
+ | 0.5604 | 0.37 | 50 | 0.5631 | 0.6913 |
71
+ | 0.4593 | 0.75 | 100 | 0.4787 | 0.7919 |
 
 
 
72
 
73
 
74
  ### Framework versions
75
 
76
  - Transformers 4.34.1
77
+ - Pytorch 2.0.1+cu117
78
+ - Datasets 2.9.0
79
  - Tokenizers 0.14.1
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7896cb1b60f58509d4d453b641239ef553d5473662d93baa5e7dc19312bc7c5d
3
- size 894094686
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e20dcea7070816c4fe5b649a8e8b136443b4069fa66ffd3a27da4c27f0b3be35
3
+ size 894094241
spiece.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
3
+ size 791656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ae170d0795f852d225ca2cf381069c3edd5c2fe1fb06b6a9103e71f52fad795
3
- size 4536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b6d1b097bc95fef0b73e23da42f53757f5055ff207b104d59e978a870928621
3
+ size 4091