End of training

README.md

@@ -0,0 +1,66 @@
+---
+base_model: vinai/bartpho-word-base
+tags:
+- generated_from_trainer
+metrics:
+- rouge
+model-index:
+- name: bartpho-word-base-finetuned-ee
+ results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# bartpho-word-base-finetuned-ee
+
+This model is a fine-tuned version of [vinai/bartpho-word-base](https://huggingface.co/vinai/bartpho-word-base) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.0116
+- Rouge1: 88.7657
+- Rouge2: 79.4792
+- Rougel: 88.7741
+- Rougelsum: 88.763
+- Gen Len: 9.7227
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
+| 0.0185 | 1.0 | 1492 | 0.0137 | 87.7748 | 77.4443 | 87.7942 | 87.7914 | 9.7606 |
+| 0.0124 | 2.0 | 2984 | 0.0121 | 87.7891 | 77.3659 | 87.7946 | 87.7802 | 9.8511 |
+| 0.0093 | 3.0 | 4476 | 0.0116 | 88.7657 | 79.4792 | 88.7741 | 88.763 | 9.7227 |
+
+
+### Framework versions
+
+- Transformers 4.41.1
+- Pytorch 2.3.0+cu121
+- Datasets 2.19.1
+- Tokenizers 0.19.1

generation_config.json

@@ -0,0 +1,8 @@
+{
+ "bos_token_id": 0,
+ "decoder_start_token_id": 2,
+ "eos_token_id": 2,
+ "forced_eos_token_id": 2,
+ "pad_token_id": 1,
+ "transformers_version": "4.41.1"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:182d79f327d881bada32efbc0c043e2f65b77797bc96ae5b9a56af5b4b3491bd
+oid sha256:4c49c05074503c6a5ffbf1c9b83287edb1293b16565e9b03e49b86233aba70e2
 size 600177236

runs/May30_12-27-57_9672968d9ce4/events.out.tfevents.1717072078.9672968d9ce4.1177.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1c69240a9e89f2ef61658f0071aadd31d4e440ac2a71f9b9180e27791468fb5a
-size 8033
+oid sha256:c719c2975868a6d7682608552717812aef3678a1f1c0ba3ed678a22af4f8202b
+size 8912

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8b519cebcb5ff1bcb80d84d067fc8bc46b400a57524ff8b32965a93af2d3d88b
+oid sha256:1d625d563b104dab95afed00f3d9be977573ddf65735bf288af8e40d0b028956
 size 5304