HARDYCHEN commited on
Commit
76ce031
·
verified ·
1 Parent(s): 0c8e426

End of training

Browse files
README.md CHANGED
@@ -3,6 +3,8 @@ license: apache-2.0
3
  base_model: Falconsai/text_summarization
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: text_summarization_finetuned2
8
  results: []
@@ -15,17 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [Falconsai/text_summarization](https://huggingface.co/Falconsai/text_summarization) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - eval_loss: 0.2328
19
- - eval_rouge1: 0.0876
20
- - eval_rouge2: 0.0826
21
- - eval_rougeL: 0.0876
22
- - eval_rougeLsum: 0.0876
23
- - eval_gen_len: 19.0
24
- - eval_runtime: 1482.5408
25
- - eval_samples_per_second: 6.262
26
- - eval_steps_per_second: 6.262
27
- - epoch: 2.0
28
- - step: 74258
29
 
30
  ## Model description
31
 
@@ -45,14 +42,23 @@ More information needed
45
 
46
  The following hyperparameters were used during training:
47
  - learning_rate: 2e-05
48
- - train_batch_size: 1
49
- - eval_batch_size: 1
50
  - seed: 42
51
  - distributed_type: multi-GPU
52
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
  - lr_scheduler_type: linear
54
  - num_epochs: 4
55
- - mixed_precision_training: Native AMP
 
 
 
 
 
 
 
 
 
56
 
57
  ### Framework versions
58
 
 
3
  base_model: Falconsai/text_summarization
4
  tags:
5
  - generated_from_trainer
6
+ metrics:
7
+ - rouge
8
  model-index:
9
  - name: text_summarization_finetuned2
10
  results: []
 
17
 
18
  This model is a fine-tuned version of [Falconsai/text_summarization](https://huggingface.co/Falconsai/text_summarization) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.3126
21
+ - Rouge1: 0.0675
22
+ - Rouge2: 0.0578
23
+ - Rougel: 0.0674
24
+ - Rougelsum: 0.0674
25
+ - Gen Len: 19.0
 
 
 
 
 
26
 
27
  ## Model description
28
 
 
42
 
43
  The following hyperparameters were used during training:
44
  - learning_rate: 2e-05
45
+ - train_batch_size: 2
46
+ - eval_batch_size: 2
47
  - seed: 42
48
  - distributed_type: multi-GPU
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
  - num_epochs: 4
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
56
+ |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
57
+ | 0.4139 | 1.0 | 2000 | 0.3411 | 0.0632 | 0.0524 | 0.0632 | 0.0632 | 19.0 |
58
+ | 0.3635 | 2.0 | 4000 | 0.3215 | 0.0658 | 0.0557 | 0.0658 | 0.0658 | 19.0 |
59
+ | 0.348 | 3.0 | 6000 | 0.3146 | 0.0668 | 0.0571 | 0.0668 | 0.0668 | 19.0 |
60
+ | 0.3445 | 4.0 | 8000 | 0.3126 | 0.0675 | 0.0578 | 0.0674 | 0.0674 | 19.0 |
61
+
62
 
63
  ### Framework versions
64
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:718e76193b3883a7584b097e53639b52771b63dfed3686e3aaaf77947b7466b9
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c19046c05d70492c124dddeb462346d25a6201b98bace0867f130953f9477d2f
3
  size 242041896
runs/Apr25_15-47-58_0423-173034-yjob166g-10-228-67-11/events.out.tfevents.1714060080.0423-173034-yjob166g-10-228-67-11.2159.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:718945e8f3827fe54884cfc4bed1c54adf490e5ce7365738ab965a757b3233ce
3
+ size 4184
runs/Apr25_15-49-41_0423-173034-yjob166g-10-228-67-11/events.out.tfevents.1714060183.0423-173034-yjob166g-10-228-67-11.2159.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6f7de6c3b6823c67d820c5dcc87cd8dc57cd8de4e9e8965c818be1132d8814e
3
+ size 10448
runs/Apr25_17-08-17_0423-173034-yjob166g-10-228-67-32/events.out.tfevents.1714064903.0423-173034-yjob166g-10-228-67-32.2180.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a100cefa3e593d3cc815aeba285543556f59a0d0896ee15f2b467ab826983211
3
+ size 5642
runs/Apr25_17-38-50_0423-173034-yjob166g-10-228-67-32/events.out.tfevents.1714066732.0423-173034-yjob166g-10-228-67-32.2180.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:475fcc7670afa536d499fcb33e4c9bca2c057ca8f1447a69ab5c53c7c5bca1f8
3
+ size 10451
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:02f9c42980689ffab05eba54c6413b4fdde159348e4371c2fd913c1fa7c3fba8
3
- size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bca2ad486a3b6c0e3e0c8b2acb6cdee38c5a40d41d749079a2da5812b3197667
3
+ size 4920