End of training

README.md

@@ -0,0 +1,73 @@
+---
+license: mit
+base_model: VietAI/vit5-base-vietnews-summarization
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: vit5-base-vietnews-summarization-standardized-number
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# vit5-base-vietnews-summarization-standardized-number
+
+This model is a fine-tuned version of [VietAI/vit5-base-vietnews-summarization](https://huggingface.co/VietAI/vit5-base-vietnews-summarization) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.8499
+- Rouge1: 79.4661
+- Rouge2: 73.7077
+- Rougel: 78.7438
+- Rougelsum: 78.7691
+- Gen Len: 7.7774
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 10
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
+| No log        | 1.0   | 297  | 0.6552          | 76.9005 | 71.0321 | 75.8172 | 75.7944   | 9.0     |
+| 0.7392        | 2.0   | 594  | 0.6097          | 77.7553 | 71.8996 | 76.945  | 76.8648   | 8.774   |
+| 0.7392        | 3.0   | 891  | 0.6585          | 76.0148 | 69.0333 | 75.1296 | 75.0746   | 7.2968  |
+| 0.3656        | 4.0   | 1188 | 0.6418          | 78.8957 | 73.2204 | 78.2513 | 78.1601   | 8.4789  |
+| 0.3656        | 5.0   | 1485 | 0.6949          | 79.3154 | 73.5637 | 78.5601 | 78.4102   | 8.231   |
+| 0.2499        | 6.0   | 1782 | 0.7310          | 78.869  | 72.9484 | 78.0106 | 77.9337   | 8.2192  |
+| 0.168         | 7.0   | 2079 | 0.7773          | 79.2397 | 73.3195 | 78.4037 | 78.3662   | 7.9595  |
+| 0.168         | 8.0   | 2376 | 0.7948          | 79.7476 | 73.8644 | 79.0204 | 78.9762   | 7.656   |
+| 0.1239        | 9.0   | 2673 | 0.8483          | 79.4961 | 73.7248 | 78.6887 | 78.7077   | 7.6779  |
+| 0.1239        | 10.0  | 2970 | 0.8499          | 79.4661 | 73.7077 | 78.7438 | 78.7691   | 7.7774  |
+
+
+### Framework versions
+
+- Transformers 4.33.0
+- Pytorch 2.0.0
+- Datasets 2.1.0
+- Tokenizers 0.13.3

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.33.0"
+}

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dd1182433cc638000684d9d5401027eaf7579dd7edb9887fecab3adc6313b68c
+oid sha256:b3c5a053dcb8e2db168244d1845207bbebb2ff3d60e79a14efdf8b68af0a49c9
 size 903892625