t5-text2sql_v1 / README.md
mousaazari's picture
update model card README.md
7a07b68
|
raw
history blame
4.48 kB
metadata
license: apache-2.0
tags:
  - generated_from_trainer
model-index:
  - name: t5-text2sql_v1
    results: []

t5-text2sql_v1

This model is a fine-tuned version of t5-base on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0747
  • Rouge2 Precision: 0.9484
  • Rouge2 Recall: 0.326
  • Rouge2 Fmeasure: 0.4583

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 30

Training results

Training Loss Epoch Step Validation Loss Rouge2 Precision Rouge2 Recall Rouge2 Fmeasure
No log 1.0 11 2.1363 0.0475 0.0107 0.0173
No log 2.0 22 1.3415 0.0484 0.0107 0.0173
No log 3.0 33 0.8590 0.0445 0.0119 0.0182
No log 4.0 44 0.5496 0.2166 0.0839 0.1172
No log 5.0 55 0.3879 0.4392 0.1919 0.2518
No log 6.0 66 0.2915 0.721 0.2583 0.358
No log 7.0 77 0.2325 0.7907 0.2682 0.3822
No log 8.0 88 0.1910 0.8413 0.2882 0.4065
No log 9.0 99 0.1734 0.8407 0.2957 0.4122
No log 10.0 110 0.1453 0.8895 0.3207 0.4452
No log 11.0 121 0.1276 0.873 0.3112 0.4318
No log 12.0 132 0.1236 0.8487 0.3035 0.4231
No log 13.0 143 0.1173 0.8374 0.3013 0.4186
No log 14.0 154 0.1085 0.8929 0.3129 0.4386
No log 15.0 165 0.1001 0.9154 0.32 0.4496
No log 16.0 176 0.0971 0.8843 0.3153 0.4418
No log 17.0 187 0.0931 0.9082 0.3249 0.4521
No log 18.0 198 0.0870 0.9048 0.3172 0.4442
No log 19.0 209 0.0838 0.9295 0.3215 0.4524
No log 20.0 220 0.0842 0.9524 0.3301 0.4632
No log 21.0 231 0.0824 0.9524 0.3301 0.4632
No log 22.0 242 0.0801 0.9524 0.3286 0.4618
No log 23.0 253 0.0789 0.9304 0.3192 0.4483
No log 24.0 264 0.0778 0.9304 0.3192 0.4483
No log 25.0 275 0.0768 0.9304 0.3178 0.4467
No log 26.0 286 0.0762 0.9341 0.3205 0.4512
No log 27.0 297 0.0755 0.9484 0.326 0.4583
No log 28.0 308 0.0752 0.9484 0.326 0.4583
No log 29.0 319 0.0749 0.9484 0.326 0.4583
No log 30.0 330 0.0747 0.9484 0.326 0.4583

Framework versions

  • Transformers 4.21.1
  • Pytorch 1.12.1+cu113
  • Datasets 2.4.0
  • Tokenizers 0.12.1