File size: 44,219 Bytes
b486415
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
---
license: cc-by-nc-sa-4.0
tags:
- generated_from_trainer
model-index:
- name: lmv2-g-receipts3
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# lmv2-g-receipts3

This model is a fine-tuned version of [microsoft/layoutlmv2-large-uncased](https://huggingface.co/microsoft/layoutlmv2-large-uncased) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2709
- Purchase Time Precision: 0.8976
- Purchase Time Recall: 0.8906
- Purchase Time F1: 0.8941
- Purchase Time Number: 128
- Receipt Date Precision: 0.9064
- Receipt Date Recall: 0.9172
- Receipt Date F1: 0.9118
- Receipt Date Number: 169
- Sub Total Precision: 0.8167
- Sub Total Recall: 0.8909
- Sub Total F1: 0.8522
- Sub Total Number: 110
- Supplier Address Precision: 0.7227
- Supplier Address Recall: 0.7544
- Supplier Address F1: 0.7382
- Supplier Address Number: 114
- Supplier Name Precision: 0.7556
- Supplier Name Recall: 0.7640
- Supplier Name F1: 0.7598
- Supplier Name Number: 267
- Tip Amount Precision: 1.0
- Tip Amount Recall: 1.0
- Tip Amount F1: 1.0
- Tip Amount Number: 2
- Total Precision: 0.9405
- Total Recall: 0.8634
- Total F1: 0.9003
- Total Number: 183
- Total Tax Amount Precision: 0.9138
- Total Tax Amount Recall: 0.8154
- Total Tax Amount F1: 0.8618
- Total Tax Amount Number: 65
- Overall Precision: 0.8406
- Overall Recall: 0.8382
- Overall F1: 0.8394
- Overall Accuracy: 0.9771

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 1
- eval_batch_size: 1
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 50

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Purchase Time Precision | Purchase Time Recall | Purchase Time F1 | Purchase Time Number | Receipt Date Precision | Receipt Date Recall | Receipt Date F1 | Receipt Date Number | Sub Total Precision | Sub Total Recall | Sub Total F1 | Sub Total Number | Supplier Address Precision | Supplier Address Recall | Supplier Address F1 | Supplier Address Number | Supplier Name Precision | Supplier Name Recall | Supplier Name F1 | Supplier Name Number | Tip Amount Precision | Tip Amount Recall | Tip Amount F1 | Tip Amount Number | Total Precision | Total Recall | Total F1 | Total Number | Total Tax Amount Precision | Total Tax Amount Recall | Total Tax Amount F1 | Total Tax Amount Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:---------------:|:------------:|:--------:|:------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.2395        | 1.0   | 793   | 0.1693          | 0.8712                  | 0.8984               | 0.8846           | 128                  | 0.8398                 | 0.8994              | 0.8686          | 169                 | 0.8247              | 0.7273           | 0.7729       | 110              | 0.5621                     | 0.7544                  | 0.6442              | 114                     | 0.6822                  | 0.6592               | 0.6705           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8242          | 0.8197       | 0.8219   | 183          | 0.5185                     | 0.8615                  | 0.6474              | 65                      | 0.7336            | 0.7852         | 0.7585     | 0.9653           |
| 0.0927        | 2.0   | 1586  | 0.1365          | 0.8406                  | 0.9062               | 0.8722           | 128                  | 0.8827                 | 0.9349              | 0.9080          | 169                 | 0.8866              | 0.7818           | 0.8309       | 110              | 0.5968                     | 0.6491                  | 0.6218              | 114                     | 0.7027                  | 0.6816               | 0.6920           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.7788          | 0.8852       | 0.8286   | 183          | 0.7237                     | 0.8462                  | 0.7801              | 65                      | 0.7706            | 0.8025         | 0.7862     | 0.9733           |
| 0.0596        | 3.0   | 2379  | 0.1552          | 0.9048                  | 0.8906               | 0.8976           | 128                  | 0.8548                 | 0.9408              | 0.8958          | 169                 | 0.776               | 0.8818           | 0.8255       | 110              | 0.6443                     | 0.8421                  | 0.7300              | 114                     | 0.6945                  | 0.7154               | 0.7048           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.7814          | 0.9180       | 0.8442   | 183          | 0.8571                     | 0.8308                  | 0.8438              | 65                      | 0.7717            | 0.8468         | 0.8075     | 0.9728           |
| 0.0476        | 4.0   | 3172  | 0.1411          | 0.888                   | 0.8672               | 0.8775           | 128                  | 0.8941                 | 0.8994              | 0.8968          | 169                 | 0.8017              | 0.8818           | 0.8398       | 110              | 0.6479                     | 0.8070                  | 0.7188              | 114                     | 0.7287                  | 0.7041               | 0.7162           | 267                  | 0.0                  | 0.0               | 0.0           | 2                 | 0.8564          | 0.8798       | 0.8679   | 183          | 0.7778                     | 0.8615                  | 0.8175              | 65                      | 0.7965            | 0.8256         | 0.8108     | 0.9765           |
| 0.0324        | 5.0   | 3965  | 0.1766          | 0.8992                  | 0.9062               | 0.9027           | 128                  | 0.8933                 | 0.9408              | 0.9164          | 169                 | 0.8319              | 0.8545           | 0.8430       | 110              | 0.6769                     | 0.7719                  | 0.7213              | 114                     | 0.7530                  | 0.6966               | 0.7237           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8049          | 0.9016       | 0.8505   | 183          | 0.7778                     | 0.8615                  | 0.8175              | 65                      | 0.8048            | 0.8343         | 0.8193     | 0.9765           |
| 0.0273        | 6.0   | 4758  | 0.2100          | 0.9062                  | 0.9062               | 0.9062           | 128                  | 0.8920                 | 0.9290              | 0.9101          | 169                 | 0.8455              | 0.8455           | 0.8455       | 110              | 0.6567                     | 0.7719                  | 0.7097              | 114                     | 0.744                   | 0.6966               | 0.7195           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8842          | 0.9180       | 0.9008   | 183          | 0.7639                     | 0.8462                  | 0.8029              | 65                      | 0.8145            | 0.8333         | 0.8238     | 0.9752           |
| 0.0207        | 7.0   | 5551  | 0.1994          | 0.925                   | 0.8672               | 0.8952           | 128                  | 0.8533                 | 0.9290              | 0.8895          | 169                 | 0.8679              | 0.8364           | 0.8519       | 110              | 0.5696                     | 0.7895                  | 0.6618              | 114                     | 0.8050                  | 0.7266               | 0.7638           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8730          | 0.9016       | 0.8871   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8139            | 0.8343         | 0.8240     | 0.9748           |
| 0.0172        | 8.0   | 6344  | 0.1989          | 0.8846                  | 0.8984               | 0.8915           | 128                  | 0.8674                 | 0.9290              | 0.8971          | 169                 | 0.8158              | 0.8455           | 0.8304       | 110              | 0.6940                     | 0.8158                  | 0.75                | 114                     | 0.7366                  | 0.7228               | 0.7297           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8737          | 0.9071       | 0.8901   | 183          | 0.7733                     | 0.8923                  | 0.8286              | 65                      | 0.8061            | 0.8449         | 0.8250     | 0.9776           |
| 0.0153        | 9.0   | 7137  | 0.2238          | 0.8636                  | 0.8906               | 0.8769           | 128                  | 0.8674                 | 0.9290              | 0.8971          | 169                 | 0.8679              | 0.8364           | 0.8519       | 110              | 0.6438                     | 0.8246                  | 0.7231              | 114                     | 0.7153                  | 0.7341               | 0.7246           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8490          | 0.8907       | 0.8693   | 183          | 0.8358                     | 0.8615                  | 0.8485              | 65                      | 0.7945            | 0.8420         | 0.8176     | 0.9744           |
| 0.0099        | 10.0  | 7930  | 0.2257          | 0.912                   | 0.8906               | 0.9012           | 128                  | 0.9080                 | 0.9349              | 0.9213          | 169                 | 0.8304              | 0.8455           | 0.8378       | 110              | 0.6667                     | 0.7544                  | 0.7078              | 114                     | 0.7444                  | 0.7416               | 0.7430           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8865          | 0.8962       | 0.8913   | 183          | 0.8438                     | 0.8308                  | 0.8372              | 65                      | 0.8221            | 0.8372         | 0.8296     | 0.9779           |
| 0.0093        | 11.0  | 8723  | 0.2294          | 0.8760                  | 0.8828               | 0.8794           | 128                  | 0.8722                 | 0.9290              | 0.8997          | 169                 | 0.8462              | 0.8              | 0.8224       | 110              | 0.7287                     | 0.8246                  | 0.7737              | 114                     | 0.7481                  | 0.7453               | 0.7467           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8703          | 0.8798       | 0.875    | 183          | 0.8056                     | 0.8923                  | 0.8467              | 65                      | 0.8172            | 0.8401         | 0.8285     | 0.9767           |
| 0.0086        | 12.0  | 9516  | 0.2368          | 0.9                     | 0.9141               | 0.9070           | 128                  | 0.8864                 | 0.9231              | 0.9043          | 169                 | 0.8378              | 0.8455           | 0.8416       | 110              | 0.7876                     | 0.7807                  | 0.7841              | 114                     | 0.764                   | 0.7154               | 0.7389           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8610          | 0.8798       | 0.8703   | 183          | 0.8667                     | 0.8                     | 0.832               | 65                      | 0.8367            | 0.8295         | 0.8331     | 0.9771           |
| 0.0082        | 13.0  | 10309 | 0.2524          | 0.8915                  | 0.8984               | 0.8949           | 128                  | 0.8807                 | 0.9172              | 0.8986          | 169                 | 0.8835              | 0.8273           | 0.8545       | 110              | 0.736                      | 0.8070                  | 0.7699              | 114                     | 0.7138                  | 0.7191               | 0.7164           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8594          | 0.9016       | 0.88     | 183          | 0.6988                     | 0.8923                  | 0.7838              | 65                      | 0.8063            | 0.8382         | 0.8219     | 0.9757           |
| 0.0067        | 14.0  | 11102 | 0.2444          | 0.9062                  | 0.9062               | 0.9062           | 128                  | 0.8870                 | 0.9290              | 0.9075          | 169                 | 0.8407              | 0.8636           | 0.8520       | 110              | 0.7023                     | 0.8070                  | 0.7510              | 114                     | 0.7196                  | 0.7303               | 0.7249           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8804          | 0.8852       | 0.8828   | 183          | 0.8028                     | 0.8769                  | 0.8382              | 65                      | 0.8134            | 0.8439         | 0.8284     | 0.9762           |
| 0.0065        | 15.0  | 11895 | 0.2598          | 0.9048                  | 0.8906               | 0.8976           | 128                  | 0.8626                 | 0.9290              | 0.8946          | 169                 | 0.8624              | 0.8545           | 0.8584       | 110              | 0.6454                     | 0.7982                  | 0.7137              | 114                     | 0.6814                  | 0.7528               | 0.7153           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8763          | 0.8907       | 0.8835   | 183          | 0.8730                     | 0.8462                  | 0.8594              | 65                      | 0.7944            | 0.8449         | 0.8189     | 0.9746           |
| 0.0067        | 16.0  | 12688 | 0.2483          | 0.8992                  | 0.9062               | 0.9027           | 128                  | 0.8857                 | 0.9172              | 0.9012          | 169                 | 0.8585              | 0.8273           | 0.8426       | 110              | 0.7381                     | 0.8158                  | 0.775               | 114                     | 0.7348                  | 0.7266               | 0.7307           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8870          | 0.8579       | 0.8722   | 183          | 0.8889                     | 0.8615                  | 0.8750              | 65                      | 0.8292            | 0.8324         | 0.8308     | 0.9774           |
| 0.0053        | 17.0  | 13481 | 0.2762          | 0.9106                  | 0.875                | 0.8924           | 128                  | 0.8851                 | 0.9112              | 0.8980          | 169                 | 0.8641              | 0.8091           | 0.8357       | 110              | 0.6403                     | 0.7807                  | 0.7036              | 114                     | 0.7469                  | 0.6854               | 0.7148           | 267                  | 1.0                  | 0.5               | 0.6667        | 2                 | 0.875           | 0.8798       | 0.8774   | 183          | 0.9167                     | 0.8462                  | 0.8800              | 65                      | 0.8202            | 0.8131         | 0.8166     | 0.9755           |
| 0.0052        | 18.0  | 14274 | 0.2549          | 0.9062                  | 0.9062               | 0.9062           | 128                  | 0.8814                 | 0.9231              | 0.9017          | 169                 | 0.8774              | 0.8455           | 0.8611       | 110              | 0.6812                     | 0.8246                  | 0.7460              | 114                     | 0.7481                  | 0.7341               | 0.7410           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8677          | 0.8962       | 0.8817   | 183          | 0.7867                     | 0.9077                  | 0.8429              | 65                      | 0.8171            | 0.8478         | 0.8322     | 0.9763           |
| 0.0049        | 19.0  | 15067 | 0.2724          | 0.8760                  | 0.8828               | 0.8794           | 128                  | 0.8708                 | 0.9172              | 0.8934          | 169                 | 0.8390              | 0.9              | 0.8684       | 110              | 0.6458                     | 0.8158                  | 0.7209              | 114                     | 0.7117                  | 0.7303               | 0.7209           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8973          | 0.9071       | 0.9022   | 183          | 0.8209                     | 0.8462                  | 0.8333              | 65                      | 0.8004            | 0.8459         | 0.8225     | 0.9759           |
| 0.0039        | 20.0  | 15860 | 0.2929          | 0.9167                  | 0.8594               | 0.8871           | 128                  | 0.8929                 | 0.8876              | 0.8902          | 169                 | 0.8679              | 0.8364           | 0.8519       | 110              | 0.7333                     | 0.7719                  | 0.7521              | 114                     | 0.8106                  | 0.6891               | 0.7449           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8967          | 0.9016       | 0.8992   | 183          | 0.7917                     | 0.8769                  | 0.8321              | 65                      | 0.8488            | 0.8170         | 0.8326     | 0.9755           |
| 0.0033        | 21.0  | 16653 | 0.2467          | 0.9055                  | 0.8984               | 0.9020           | 128                  | 0.8902                 | 0.9112              | 0.9006          | 169                 | 0.8692              | 0.8455           | 0.8571       | 110              | 0.7154                     | 0.7719                  | 0.7426              | 114                     | 0.7378                  | 0.7378               | 0.7378           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8889          | 0.9180       | 0.9032   | 183          | 0.8485                     | 0.8615                  | 0.8550              | 65                      | 0.8283            | 0.8410         | 0.8346     | 0.9781           |
| 0.0021        | 22.0  | 17446 | 0.2560          | 0.912                   | 0.8906               | 0.9012           | 128                  | 0.8960                 | 0.9172              | 0.9064          | 169                 | 0.8230              | 0.8455           | 0.8341       | 110              | 0.6875                     | 0.7719                  | 0.7273              | 114                     | 0.7462                  | 0.7378               | 0.7420           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.9213          | 0.8962       | 0.9086   | 183          | 0.8382                     | 0.8769                  | 0.8571              | 65                      | 0.8278            | 0.8382         | 0.8329     | 0.9776           |
| 0.0017        | 23.0  | 18239 | 0.2891          | 0.9048                  | 0.8906               | 0.8976           | 128                  | 0.8920                 | 0.9290              | 0.9101          | 169                 | 0.8932              | 0.8364           | 0.8638       | 110              | 0.6905                     | 0.7632                  | 0.725               | 114                     | 0.75                    | 0.7079               | 0.7283           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.9066          | 0.9016       | 0.9041   | 183          | 0.7308                     | 0.8769                  | 0.7972              | 65                      | 0.8258            | 0.8314         | 0.8286     | 0.9764           |
| 0.0055        | 24.0  | 19032 | 0.2853          | 0.8837                  | 0.8906               | 0.8872           | 128                  | 0.8708                 | 0.9172              | 0.8934          | 169                 | 0.8462              | 0.8              | 0.8224       | 110              | 0.6692                     | 0.7807                  | 0.7206              | 114                     | 0.7153                  | 0.7341               | 0.7246           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8907          | 0.8907       | 0.8907   | 183          | 0.8710                     | 0.8308                  | 0.8504              | 65                      | 0.8085            | 0.8295         | 0.8188     | 0.9760           |
| 0.0018        | 25.0  | 19825 | 0.3104          | 0.912                   | 0.8906               | 0.9012           | 128                  | 0.8902                 | 0.9112              | 0.9006          | 169                 | 0.8364              | 0.8364           | 0.8364       | 110              | 0.6984                     | 0.7719                  | 0.7333              | 114                     | 0.7668                  | 0.7266               | 0.7462           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8865          | 0.8962       | 0.8913   | 183          | 0.9455                     | 0.8                     | 0.8667              | 65                      | 0.8358            | 0.8285         | 0.8321     | 0.9758           |
| 0.0014        | 26.0  | 20618 | 0.3030          | 0.8828                  | 0.8828               | 0.8828           | 128                  | 0.8908                 | 0.9172              | 0.9038          | 169                 | 0.9231              | 0.7636           | 0.8358       | 110              | 0.7008                     | 0.7807                  | 0.7386              | 114                     | 0.7683                  | 0.7079               | 0.7368           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8871          | 0.9016       | 0.8943   | 183          | 0.8889                     | 0.8615                  | 0.8750              | 65                      | 0.8387            | 0.8218         | 0.8302     | 0.9761           |
| 0.0018        | 27.0  | 21411 | 0.2970          | 0.8692                  | 0.8828               | 0.8760           | 128                  | 0.8864                 | 0.9231              | 0.9043          | 169                 | 0.8476              | 0.8091           | 0.8279       | 110              | 0.6947                     | 0.7982                  | 0.7429              | 114                     | 0.7660                  | 0.7603               | 0.7632           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.9011          | 0.8962       | 0.8986   | 183          | 0.8710                     | 0.8308                  | 0.8504              | 65                      | 0.8281            | 0.8401         | 0.8341     | 0.9766           |
| 0.0013        | 28.0  | 22204 | 0.2850          | 0.8779                  | 0.8984               | 0.8880           | 128                  | 0.8851                 | 0.9112              | 0.8980          | 169                 | 0.8158              | 0.8455           | 0.8304       | 110              | 0.7031                     | 0.7895                  | 0.7438              | 114                     | 0.7595                  | 0.7453               | 0.7524           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.9148          | 0.8798       | 0.8969   | 183          | 0.8889                     | 0.8615                  | 0.8750              | 65                      | 0.8286            | 0.8382         | 0.8333     | 0.9776           |
| 0.0019        | 29.0  | 22997 | 0.2709          | 0.8976                  | 0.8906               | 0.8941           | 128                  | 0.9064                 | 0.9172              | 0.9118          | 169                 | 0.8167              | 0.8909           | 0.8522       | 110              | 0.7227                     | 0.7544                  | 0.7382              | 114                     | 0.7556                  | 0.7640               | 0.7598           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.9405          | 0.8634       | 0.9003   | 183          | 0.9138                     | 0.8154                  | 0.8618              | 65                      | 0.8406            | 0.8382         | 0.8394     | 0.9771           |
| 0.0014        | 30.0  | 23790 | 0.2976          | 0.8906                  | 0.8906               | 0.8906           | 128                  | 0.8947                 | 0.9053              | 0.9000          | 169                 | 0.8276              | 0.8727           | 0.8496       | 110              | 0.6742                     | 0.7807                  | 0.7236              | 114                     | 0.7303                  | 0.7303               | 0.7303           | 267                  | 0.6667               | 1.0               | 0.8           | 2                 | 0.9106          | 0.8907       | 0.9006   | 183          | 0.8871                     | 0.8462                  | 0.8661              | 65                      | 0.8195            | 0.8353         | 0.8273     | 0.9765           |
| 0.0014        | 31.0  | 24583 | 0.2994          | 0.9062                  | 0.9062               | 0.9062           | 128                  | 0.9023                 | 0.9290              | 0.9155          | 169                 | 0.8246              | 0.8545           | 0.8393       | 110              | 0.6471                     | 0.7719                  | 0.704               | 114                     | 0.7586                  | 0.7416               | 0.75             | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8783          | 0.9071       | 0.8925   | 183          | 0.8529                     | 0.8923                  | 0.8722              | 65                      | 0.8200            | 0.8468         | 0.8332     | 0.9770           |
| 0.0011        | 32.0  | 25376 | 0.2895          | 0.912                   | 0.8906               | 0.9012           | 128                  | 0.9070                 | 0.9231              | 0.9150          | 169                 | 0.8559              | 0.8636           | 0.8597       | 110              | 0.6641                     | 0.7632                  | 0.7102              | 114                     | 0.7263                  | 0.7453               | 0.7357           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8919          | 0.9016       | 0.8967   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8205            | 0.8410         | 0.8306     | 0.9770           |
| 0.0015        | 33.0  | 26169 | 0.2966          | 0.8915                  | 0.8984               | 0.8949           | 128                  | 0.9023                 | 0.9290              | 0.9155          | 169                 | 0.7965              | 0.8182           | 0.8072       | 110              | 0.6917                     | 0.8070                  | 0.7449              | 114                     | 0.7071                  | 0.7416               | 0.7239           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8859          | 0.8907       | 0.8883   | 183          | 0.8529                     | 0.8923                  | 0.8722              | 65                      | 0.8079            | 0.8430         | 0.8251     | 0.9762           |
| 0.0007        | 34.0  | 26962 | 0.3250          | 0.8915                  | 0.8984               | 0.8949           | 128                  | 0.8820                 | 0.9290              | 0.9049          | 169                 | 0.8411              | 0.8182           | 0.8295       | 110              | 0.6403                     | 0.7807                  | 0.7036              | 114                     | 0.7425                  | 0.7453               | 0.7439           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8956          | 0.8907       | 0.8932   | 183          | 0.9322                     | 0.8462                  | 0.8871              | 65                      | 0.8177            | 0.8382         | 0.8278     | 0.9751           |
| 0.0011        | 35.0  | 27755 | 0.3033          | 0.8898                  | 0.8828               | 0.8863           | 128                  | 0.8764                 | 0.9231              | 0.8991          | 169                 | 0.8532              | 0.8455           | 0.8493       | 110              | 0.7109                     | 0.7982                  | 0.7521              | 114                     | 0.7634                  | 0.7491               | 0.7561           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8871          | 0.9016       | 0.8943   | 183          | 0.9167                     | 0.8462                  | 0.8800              | 65                      | 0.8317            | 0.8430         | 0.8373     | 0.9767           |
| 0.0013        | 36.0  | 28548 | 0.3173          | 0.8898                  | 0.8828               | 0.8863           | 128                  | 0.8864                 | 0.9231              | 0.9043          | 169                 | 0.8158              | 0.8455           | 0.8304       | 110              | 0.7165                     | 0.7982                  | 0.7552              | 114                     | 0.7826                  | 0.7416               | 0.7615           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8817          | 0.8962       | 0.8889   | 183          | 0.7887                     | 0.8615                  | 0.8235              | 65                      | 0.8267            | 0.8410         | 0.8338     | 0.9766           |
| 0.0032        | 37.0  | 29341 | 0.3098          | 0.8837                  | 0.8906               | 0.8872           | 128                  | 0.8902                 | 0.9112              | 0.9006          | 169                 | 0.8532              | 0.8455           | 0.8493       | 110              | 0.7143                     | 0.7895                  | 0.7500              | 114                     | 0.7634                  | 0.7491               | 0.7561           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8859          | 0.8907       | 0.8883   | 183          | 0.9032                     | 0.8615                  | 0.8819              | 65                      | 0.8329            | 0.8401         | 0.8365     | 0.9769           |
| 0.0005        | 38.0  | 30134 | 0.3061          | 0.8837                  | 0.8906               | 0.8872           | 128                  | 0.9012                 | 0.9172              | 0.9091          | 169                 | 0.8824              | 0.8182           | 0.8491       | 110              | 0.728                      | 0.7982                  | 0.7615              | 114                     | 0.7654                  | 0.7453               | 0.7552           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8950          | 0.8852       | 0.8901   | 183          | 0.9167                     | 0.8462                  | 0.8800              | 65                      | 0.8419            | 0.8362         | 0.8391     | 0.9774           |
| 0.0003        | 39.0  | 30927 | 0.3165          | 0.8898                  | 0.8828               | 0.8863           | 128                  | 0.8857                 | 0.9172              | 0.9012          | 169                 | 0.8667              | 0.8273           | 0.8465       | 110              | 0.6917                     | 0.8070                  | 0.7449              | 114                     | 0.7567                  | 0.7453               | 0.7509           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8836          | 0.9126       | 0.8978   | 183          | 0.8235                     | 0.8615                  | 0.8421              | 65                      | 0.8239            | 0.8430         | 0.8333     | 0.9768           |
| 0.0006        | 40.0  | 31720 | 0.3112          | 0.875                   | 0.875                | 0.875            | 128                  | 0.8960                 | 0.9172              | 0.9064          | 169                 | 0.8571              | 0.8182           | 0.8372       | 110              | 0.7132                     | 0.8070                  | 0.7572              | 114                     | 0.7614                  | 0.7528               | 0.7571           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8743          | 0.9126       | 0.8930   | 183          | 0.8871                     | 0.8462                  | 0.8661              | 65                      | 0.8292            | 0.8420         | 0.8356     | 0.9769           |
| 0.0003        | 41.0  | 32513 | 0.3157          | 0.8819                  | 0.875                | 0.8784           | 128                  | 0.8814                 | 0.9231              | 0.9017          | 169                 | 0.8396              | 0.8091           | 0.8241       | 110              | 0.6866                     | 0.8070                  | 0.7419              | 114                     | 0.7218                  | 0.7678               | 0.7441           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8691          | 0.9071       | 0.8877   | 183          | 0.9310                     | 0.8308                  | 0.8780              | 65                      | 0.8119            | 0.8439         | 0.8276     | 0.9761           |
| 0.0004        | 42.0  | 33306 | 0.3131          | 0.8898                  | 0.8828               | 0.8863           | 128                  | 0.8757                 | 0.9172              | 0.8960          | 169                 | 0.8725              | 0.8091           | 0.8396       | 110              | 0.7244                     | 0.8070                  | 0.7635              | 114                     | 0.7752                  | 0.7491               | 0.7619           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8677          | 0.8962       | 0.8817   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8317            | 0.8382         | 0.8349     | 0.9778           |
| 0.0003        | 43.0  | 34099 | 0.3147          | 0.8906                  | 0.8906               | 0.8906           | 128                  | 0.8757                 | 0.9172              | 0.8960          | 169                 | 0.8378              | 0.8455           | 0.8416       | 110              | 0.7109                     | 0.7982                  | 0.7521              | 114                     | 0.7704                  | 0.7416               | 0.7557           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8624          | 0.8907       | 0.8763   | 183          | 0.8730                     | 0.8462                  | 0.8594              | 65                      | 0.8256            | 0.8391         | 0.8323     | 0.9774           |
| 0.0003        | 44.0  | 34892 | 0.3390          | 0.8828                  | 0.8828               | 0.8828           | 128                  | 0.8757                 | 0.9172              | 0.8960          | 169                 | 0.8378              | 0.8455           | 0.8416       | 110              | 0.6691                     | 0.7982                  | 0.7280              | 114                     | 0.7577                  | 0.7378               | 0.7476           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8670          | 0.8907       | 0.8787   | 183          | 0.8730                     | 0.8462                  | 0.8594              | 65                      | 0.8160            | 0.8372         | 0.8264     | 0.9756           |
| 0.0004        | 45.0  | 35685 | 0.3224          | 0.8810                  | 0.8672               | 0.8740           | 128                  | 0.8960                 | 0.9172              | 0.9064          | 169                 | 0.8364              | 0.8364           | 0.8364       | 110              | 0.7023                     | 0.8070                  | 0.7510              | 114                     | 0.7689                  | 0.7228               | 0.7452           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8624          | 0.8907       | 0.8763   | 183          | 0.875                      | 0.8615                  | 0.8682              | 65                      | 0.8260            | 0.8324         | 0.8292     | 0.9767           |
| 0.0002        | 46.0  | 36478 | 0.3259          | 0.8810                  | 0.8672               | 0.8740           | 128                  | 0.8908                 | 0.9172              | 0.9038          | 169                 | 0.8440              | 0.8364           | 0.8402       | 110              | 0.6947                     | 0.7982                  | 0.7429              | 114                     | 0.7617                  | 0.7303               | 0.7457           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8670          | 0.8907       | 0.8787   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8229            | 0.8324         | 0.8276     | 0.9767           |
| 0.0003        | 47.0  | 37271 | 0.3282          | 0.8810                  | 0.8672               | 0.8740           | 128                  | 0.8908                 | 0.9172              | 0.9038          | 169                 | 0.8440              | 0.8364           | 0.8402       | 110              | 0.7054                     | 0.7982                  | 0.7490              | 114                     | 0.7787                  | 0.7378               | 0.7577           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8763          | 0.8907       | 0.8835   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8303            | 0.8343         | 0.8323     | 0.9772           |
| 0.0001        | 48.0  | 38064 | 0.3284          | 0.8810                  | 0.8672               | 0.8740           | 128                  | 0.8953                 | 0.9112              | 0.9032          | 169                 | 0.8440              | 0.8364           | 0.8402       | 110              | 0.7398                     | 0.7982                  | 0.7679              | 114                     | 0.788                   | 0.7378               | 0.7621           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8757          | 0.8852       | 0.8804   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8380            | 0.8324         | 0.8352     | 0.9775           |
| 0.0002        | 49.0  | 38857 | 0.3272          | 0.8810                  | 0.8672               | 0.8740           | 128                  | 0.8953                 | 0.9112              | 0.9032          | 169                 | 0.8455              | 0.8455           | 0.8455       | 110              | 0.7339                     | 0.7982                  | 0.7647              | 114                     | 0.7857                  | 0.7416               | 0.7630           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8717          | 0.8907       | 0.8811   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8361            | 0.8353         | 0.8357     | 0.9777           |
| 0.0001        | 50.0  | 39650 | 0.3278          | 0.8810                  | 0.8672               | 0.8740           | 128                  | 0.8960                 | 0.9172              | 0.9064          | 169                 | 0.8455              | 0.8455           | 0.8455       | 110              | 0.7339                     | 0.7982                  | 0.7647              | 114                     | 0.7857                  | 0.7416               | 0.7630           | 267                  | 1.0                  | 1.0               | 1.0           | 2                 | 0.8717          | 0.8907       | 0.8811   | 183          | 0.8594                     | 0.8462                  | 0.8527              | 65                      | 0.8362            | 0.8362         | 0.8362     | 0.9777           |


### Framework versions

- Transformers 4.25.0.dev0
- Pytorch 1.12.1+cu113
- Datasets 2.2.2
- Tokenizers 0.13.2