File size: 42,017 Bytes
5fa7a21 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 |
---
license: mit
base_model: SCUT-DLVCLab/lilt-roberta-en-base
tags:
- generated_from_trainer
model-index:
- name: lilt_240307
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# lilt_240307
This model is a fine-tuned version of [SCUT-DLVCLab/lilt-roberta-en-base](https://huggingface.co/SCUT-DLVCLab/lilt-roberta-en-base) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0115
- Escription: {'precision': 0.999605367008682, 'recall': 0.9988170347003155, 'f1': 0.9992110453648916, 'number': 7608}
- Otalprice: {'precision': 0.9985453583708014, 'recall': 0.9986774236212141, 'f1': 0.998611386629637, 'number': 7561}
- Rice: {'precision': 0.9904117315284828, 'recall': 0.9848569826135727, 'f1': 0.9876265466816648, 'number': 1783}
- Roductcode: {'precision': 0.9869678540399652, 'recall': 0.9964912280701754, 'f1': 0.9917066783064163, 'number': 1140}
- Uantity: {'precision': 0.9971945137157108, 'recall': 0.9981279251170047, 'f1': 0.9976610010915329, 'number': 3205}
- Uantityunit: {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866}
- Overall Precision: 0.9976
- Overall Recall: 0.9976
- Overall F1: 0.9976
- Overall Accuracy: 0.9985
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- training_steps: 10000
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Escription | Otalprice | Rice | Roductcode | Uantity | Uantityunit | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:---------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.129 | 0.22 | 200 | 0.0369 | {'precision': 0.9989463979981562, 'recall': 0.9969768664563617, 'f1': 0.997960660482863, 'number': 7608} | {'precision': 0.9970330411328389, 'recall': 0.9777807168363973, 'f1': 0.9873130341880342, 'number': 7561} | {'precision': 0.9133010231556273, 'recall': 0.9512058328659563, 'f1': 0.9318681318681319, 'number': 1783} | {'precision': 0.915, 'recall': 0.9631578947368421, 'f1': 0.9384615384615383, 'number': 1140} | {'precision': 0.9952963311382879, 'recall': 0.9903276131045242, 'f1': 0.9928057553956834, 'number': 3205} | {'precision': 0.997836668469443, 'recall': 0.9887459807073955, 'f1': 0.993270524899058, 'number': 1866} | 0.9865 | 0.9839 | 0.9852 | 0.9907 |
| 0.0269 | 0.44 | 400 | 0.0287 | {'precision': 0.9994720865778013, 'recall': 0.9953995793901157, 'f1': 0.9974316759960488, 'number': 7608} | {'precision': 0.9937945603379984, 'recall': 0.995503240312128, 'f1': 0.9946481665014867, 'number': 7561} | {'precision': 0.9386767079074771, 'recall': 0.978687605159843, 'f1': 0.958264689730917, 'number': 1783} | {'precision': 0.9805013927576601, 'recall': 0.9263157894736842, 'f1': 0.9526387009472259, 'number': 1140} | {'precision': 0.9959170854271356, 'recall': 0.9893915756630265, 'f1': 0.9926436061981532, 'number': 3205} | {'precision': 0.9973204715969989, 'recall': 0.9973204715969989, 'f1': 0.9973204715969989, 'number': 1866} | 0.9912 | 0.9901 | 0.9906 | 0.9940 |
| 0.0179 | 0.66 | 600 | 0.0229 | {'precision': 0.9996033844526705, 'recall': 0.9938222923238696, 'f1': 0.9967044555760611, 'number': 7608} | {'precision': 0.9964290437772781, 'recall': 0.9964290437772781, 'f1': 0.9964290437772781, 'number': 7561} | {'precision': 0.9769533445756042, 'recall': 0.9747616376892877, 'f1': 0.9758562605277933, 'number': 1783} | {'precision': 0.9438860971524288, 'recall': 0.9885964912280701, 'f1': 0.9657240788346187, 'number': 1140} | {'precision': 0.996551724137931, 'recall': 0.9918876755070203, 'f1': 0.9942142298670836, 'number': 3205} | {'precision': 0.9989287627209427, 'recall': 0.9994640943193998, 'f1': 0.999196356817573, 'number': 1866} | 0.9935 | 0.9931 | 0.9933 | 0.9959 |
| 0.0188 | 0.88 | 800 | 0.0171 | {'precision': 0.9992083388309804, 'recall': 0.9953995793901157, 'f1': 0.9973003226443669, 'number': 7608} | {'precision': 0.9958983858163535, 'recall': 0.995503240312128, 'f1': 0.995700773860705, 'number': 7561} | {'precision': 0.9959607616849394, 'recall': 0.9680314077397645, 'f1': 0.981797497155859, 'number': 1783} | {'precision': 0.9522613065326633, 'recall': 0.9973684210526316, 'f1': 0.9742930591259639, 'number': 1140} | {'precision': 0.9940902021772939, 'recall': 0.997191887675507, 'f1': 0.9956386292834891, 'number': 3205} | {'precision': 0.9946666666666667, 'recall': 0.9994640943193998, 'f1': 0.9970596097300188, 'number': 1866} | 0.9944 | 0.9940 | 0.9942 | 0.9962 |
| 0.0117 | 1.1 | 1000 | 0.0111 | {'precision': 0.9989472298986709, 'recall': 0.9977655099894848, 'f1': 0.9983560202538305, 'number': 7608} | {'precision': 0.9978816364358533, 'recall': 0.9968258166909139, 'f1': 0.9973534471351064, 'number': 7561} | {'precision': 0.9870713884204609, 'recall': 0.9848569826135727, 'f1': 0.9859629421673217, 'number': 1783} | {'precision': 0.9766637856525497, 'recall': 0.9912280701754386, 'f1': 0.9838920330866348, 'number': 1140} | {'precision': 0.9962628464652756, 'recall': 0.9981279251170047, 'f1': 0.9971945137157107, 'number': 3205} | {'precision': 0.9989276139410188, 'recall': 0.9983922829581994, 'f1': 0.9986598767086573, 'number': 1866} | 0.9962 | 0.9962 | 0.9962 | 0.9976 |
| 0.0146 | 1.32 | 1200 | 0.0148 | {'precision': 0.9971102062261921, 'recall': 0.9977655099894848, 'f1': 0.9974377504763156, 'number': 7608} | {'precision': 0.9954972851277977, 'recall': 0.9941806639333421, 'f1': 0.9948385389094759, 'number': 7561} | {'precision': 0.9880613985218875, 'recall': 0.9747616376892877, 'f1': 0.9813664596273293, 'number': 1783} | {'precision': 0.9808529155787642, 'recall': 0.9885964912280701, 'f1': 0.9847094801223241, 'number': 1140} | {'precision': 0.9950031230480949, 'recall': 0.9940717628705148, 'f1': 0.9945372249102544, 'number': 3205} | {'precision': 0.9924812030075187, 'recall': 0.9903536977491961, 'f1': 0.9914163090128755, 'number': 1866} | 0.9944 | 0.9933 | 0.9938 | 0.9965 |
| 0.0128 | 1.54 | 1400 | 0.0183 | {'precision': 0.999604064933351, 'recall': 0.9955310199789695, 'f1': 0.9975633849193283, 'number': 7608} | {'precision': 0.9962982548915917, 'recall': 0.9966935590530354, 'f1': 0.996495867768595, 'number': 7561} | {'precision': 0.9909348441926346, 'recall': 0.9809310151430174, 'f1': 0.9859075535512964, 'number': 1783} | {'precision': 0.9655172413793104, 'recall': 0.9824561403508771, 'f1': 0.9739130434782608, 'number': 1140} | {'precision': 0.996571072319202, 'recall': 0.9975039001560062, 'f1': 0.9970372680492747, 'number': 3205} | {'precision': 0.997327632282202, 'recall': 1.0, 'f1': 0.9986620283649986, 'number': 1866} | 0.9955 | 0.9948 | 0.9952 | 0.9967 |
| 0.01 | 1.76 | 1600 | 0.0117 | {'precision': 0.9994731296101159, 'recall': 0.9973711882229233, 'f1': 0.9984210526315789, 'number': 7608} | {'precision': 0.9974857747783512, 'recall': 0.9969580743287925, 'f1': 0.9972218547426909, 'number': 7561} | {'precision': 0.9843225083986562, 'recall': 0.9859786876051598, 'f1': 0.9851499019333148, 'number': 1783} | {'precision': 0.9754385964912281, 'recall': 0.9754385964912281, 'f1': 0.9754385964912281, 'number': 1140} | {'precision': 0.9975015615240475, 'recall': 0.9965678627145086, 'f1': 0.9970344935227097, 'number': 3205} | {'precision': 0.9978598180845372, 'recall': 0.9994640943193998, 'f1': 0.9986613119143238, 'number': 1866} | 0.9961 | 0.9953 | 0.9957 | 0.9972 |
| 0.0134 | 1.98 | 1800 | 0.0128 | {'precision': 0.9990791896869244, 'recall': 0.9982912723449001, 'f1': 0.9986850756081526, 'number': 7608} | {'precision': 0.9966957441184245, 'recall': 0.9973548472424283, 'f1': 0.997025186752165, 'number': 7561} | {'precision': 0.9903737259343148, 'recall': 0.9809310151430174, 'f1': 0.9856297548605241, 'number': 1783} | {'precision': 0.970714900947459, 'recall': 0.9885964912280701, 'f1': 0.979574098218166, 'number': 1140} | {'precision': 0.9984350547730829, 'recall': 0.9953198127925117, 'f1': 0.9968750000000001, 'number': 3205} | {'precision': 0.9994640943193998, 'recall': 0.9994640943193998, 'f1': 0.9994640943193998, 'number': 1866} | 0.9962 | 0.9959 | 0.9960 | 0.9976 |
| 0.0099 | 2.2 | 2000 | 0.0140 | {'precision': 0.9993413252535898, 'recall': 0.9971083070452156, 'f1': 0.9982235673399565, 'number': 7608} | {'precision': 0.9970868644067796, 'recall': 0.9959000132257638, 'f1': 0.9964930854231456, 'number': 7561} | {'precision': 0.9903791737408036, 'recall': 0.981491867638811, 'f1': 0.9859154929577465, 'number': 1783} | {'precision': 0.9716251074806534, 'recall': 0.9912280701754386, 'f1': 0.9813287016934433, 'number': 1140} | {'precision': 0.9968837644125896, 'recall': 0.9981279251170047, 'f1': 0.9975054568132211, 'number': 3205} | {'precision': 0.9957310565635006, 'recall': 1.0, 'f1': 0.9978609625668449, 'number': 1866} | 0.9959 | 0.9956 | 0.9957 | 0.9972 |
| 0.008 | 2.42 | 2200 | 0.0156 | {'precision': 0.9993417588204319, 'recall': 0.9977655099894848, 'f1': 0.998553012365167, 'number': 7608} | {'precision': 0.9982763192787059, 'recall': 0.9957677555878852, 'f1': 0.9970204595113553, 'number': 7561} | {'precision': 0.9920769666100736, 'recall': 0.9831744251261918, 'f1': 0.987605633802817, 'number': 1783} | {'precision': 0.9667519181585678, 'recall': 0.9947368421052631, 'f1': 0.980544747081712, 'number': 1140} | {'precision': 0.9919354838709677, 'recall': 0.9978159126365055, 'f1': 0.9948670088660756, 'number': 3205} | {'precision': 0.9983940042826552, 'recall': 0.9994640943193998, 'f1': 0.9989287627209427, 'number': 1866} | 0.9957 | 0.9960 | 0.9958 | 0.9975 |
| 0.0147 | 2.64 | 2400 | 0.0110 | {'precision': 0.998290373487638, 'recall': 0.9977655099894848, 'f1': 0.9980278727320536, 'number': 7608} | {'precision': 0.9986760227724083, 'recall': 0.9976193625181854, 'f1': 0.9981474129945745, 'number': 7561} | {'precision': 0.9926010244735345, 'recall': 0.9781267526640494, 'f1': 0.9853107344632769, 'number': 1783} | {'precision': 0.9718189581554227, 'recall': 0.9982456140350877, 'f1': 0.9848550411077457, 'number': 1140} | {'precision': 0.9981279251170047, 'recall': 0.9981279251170047, 'f1': 0.9981279251170047, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9967 | 0.9965 | 0.9966 | 0.9979 |
| 0.0095 | 2.86 | 2600 | 0.0106 | {'precision': 0.9998684210526316, 'recall': 0.9988170347003155, 'f1': 0.9993424513413993, 'number': 7608} | {'precision': 0.9948508053868498, 'recall': 0.9965613014151568, 'f1': 0.9957053187974892, 'number': 7561} | {'precision': 0.9765494137353434, 'recall': 0.9809310151430174, 'f1': 0.9787353105763851, 'number': 1783} | {'precision': 0.9963302752293578, 'recall': 0.9526315789473684, 'f1': 0.9739910313901345, 'number': 1140} | {'precision': 0.9956440572495333, 'recall': 0.9984399375975039, 'f1': 0.9970400373890015, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9957 | 0.9945 | 0.9951 | 0.9970 |
| 0.0068 | 3.08 | 2800 | 0.0092 | {'precision': 0.9996052112120016, 'recall': 0.998422712933754, 'f1': 0.9990136121522984, 'number': 7608} | {'precision': 0.9988087359364659, 'recall': 0.9980161354318212, 'f1': 0.998412278380524, 'number': 7561} | {'precision': 0.9821528165086447, 'recall': 0.9876612450925406, 'f1': 0.9848993288590603, 'number': 1783} | {'precision': 0.9876434245366285, 'recall': 0.9815789473684211, 'f1': 0.9846018477782666, 'number': 1140} | {'precision': 0.9971945137157108, 'recall': 0.9981279251170047, 'f1': 0.9976610010915329, 'number': 3205} | {'precision': 0.9989293361884368, 'recall': 1.0, 'f1': 0.9994643813604713, 'number': 1866} | 0.9970 | 0.9967 | 0.9969 | 0.9980 |
| 0.0054 | 3.3 | 3000 | 0.0100 | {'precision': 0.9997367035281727, 'recall': 0.9981598317560463, 'f1': 0.9989476453564851, 'number': 7608} | {'precision': 0.9984131182226924, 'recall': 0.9985451659833355, 'f1': 0.9984791377372215, 'number': 7561} | {'precision': 0.9960227272727272, 'recall': 0.9831744251261918, 'f1': 0.9895568727067456, 'number': 1783} | {'precision': 0.9767241379310345, 'recall': 0.993859649122807, 'f1': 0.9852173913043478, 'number': 1140} | {'precision': 0.9956413449564134, 'recall': 0.9978159126365055, 'f1': 0.9967274427302478, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9973 | 0.9970 | 0.9972 | 0.9982 |
| 0.0073 | 3.52 | 3200 | 0.0125 | {'precision': 0.999079673941625, 'recall': 0.9988170347003155, 'f1': 0.9989483370579728, 'number': 7608} | {'precision': 0.9985449735449735, 'recall': 0.9984129083454569, 'f1': 0.9984789365782686, 'number': 7561} | {'precision': 0.9832026875699889, 'recall': 0.9848569826135727, 'f1': 0.9840291398150743, 'number': 1783} | {'precision': 0.9833479404031551, 'recall': 0.9842105263157894, 'f1': 0.9837790442788251, 'number': 1140} | {'precision': 0.9971927635683094, 'recall': 0.9975039001560062, 'f1': 0.9973483075963188, 'number': 3205} | {'precision': 0.9989276139410188, 'recall': 0.9983922829581994, 'f1': 0.9986598767086573, 'number': 1866} | 0.9966 | 0.9967 | 0.9967 | 0.9979 |
| 0.0109 | 3.74 | 3400 | 0.0132 | {'precision': 0.9997367381861261, 'recall': 0.9982912723449001, 'f1': 0.999013482407103, 'number': 7608} | {'precision': 0.9970949425590915, 'recall': 0.9986774236212141, 'f1': 0.9978855557023919, 'number': 7561} | {'precision': 0.9915158371040724, 'recall': 0.9831744251261918, 'f1': 0.9873275133765137, 'number': 1783} | {'precision': 0.9801381692573402, 'recall': 0.9956140350877193, 'f1': 0.9878154917319407, 'number': 1140} | {'precision': 0.9984345648090169, 'recall': 0.9950078003120125, 'f1': 0.9967182372245664, 'number': 3205} | {'precision': 0.9989293361884368, 'recall': 1.0, 'f1': 0.9994643813604713, 'number': 1866} | 0.9970 | 0.9968 | 0.9969 | 0.9979 |
| 0.0063 | 3.96 | 3600 | 0.0121 | {'precision': 0.9980281319836992, 'recall': 0.9978969505783386, 'f1': 0.9979625369700953, 'number': 7608} | {'precision': 0.9988084204951675, 'recall': 0.997751620156064, 'f1': 0.9982797406378192, 'number': 7561} | {'precision': 0.9814606741573034, 'recall': 0.9798093101514301, 'f1': 0.9806342969407803, 'number': 1783} | {'precision': 0.9833770778652668, 'recall': 0.9859649122807017, 'f1': 0.9846692947875603, 'number': 1140} | {'precision': 0.9968857053877297, 'recall': 0.9987519500780031, 'f1': 0.9978179551122195, 'number': 3205} | {'precision': 0.9989293361884368, 'recall': 1.0, 'f1': 0.9994643813604713, 'number': 1866} | 0.9962 | 0.9962 | 0.9962 | 0.9978 |
| 0.006 | 4.18 | 3800 | 0.0118 | {'precision': 0.9993423648559779, 'recall': 0.9986855941114616, 'f1': 0.9990138715403327, 'number': 7608} | {'precision': 0.9981479031617939, 'recall': 0.9978838777939426, 'f1': 0.998015873015873, 'number': 7561} | {'precision': 0.9937321937321937, 'recall': 0.9781267526640494, 'f1': 0.9858677218767665, 'number': 1783} | {'precision': 0.9784668389319552, 'recall': 0.9964912280701754, 'f1': 0.9873967840069536, 'number': 1140} | {'precision': 0.9956440572495333, 'recall': 0.9984399375975039, 'f1': 0.9970400373890015, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9970 | 0.9968 | 0.9969 | 0.9982 |
| 0.0063 | 4.4 | 4000 | 0.0117 | {'precision': 0.9989472298986709, 'recall': 0.9977655099894848, 'f1': 0.9983560202538305, 'number': 7608} | {'precision': 0.9980150853513299, 'recall': 0.9974871048803068, 'f1': 0.9977510252678925, 'number': 7561} | {'precision': 0.9864940911648846, 'recall': 0.9831744251261918, 'f1': 0.9848314606741573, 'number': 1783} | {'precision': 0.9750859106529209, 'recall': 0.9956140350877193, 'f1': 0.9852430555555555, 'number': 1140} | {'precision': 0.9981244138793373, 'recall': 0.9962558502340093, 'f1': 0.9971892567145534, 'number': 3205} | {'precision': 1.0, 'recall': 0.9994640943193998, 'f1': 0.9997319753417314, 'number': 1866} | 0.9965 | 0.9964 | 0.9964 | 0.9978 |
| 0.0042 | 4.62 | 4200 | 0.0144 | {'precision': 0.9993423648559779, 'recall': 0.9986855941114616, 'f1': 0.9990138715403327, 'number': 7608} | {'precision': 0.9965631196298744, 'recall': 0.9970903319666711, 'f1': 0.9968266560888536, 'number': 7561} | {'precision': 0.9853685987619584, 'recall': 0.9820527201346047, 'f1': 0.9837078651685394, 'number': 1783} | {'precision': 0.9750859106529209, 'recall': 0.9956140350877193, 'f1': 0.9852430555555555, 'number': 1140} | {'precision': 0.9987472596304416, 'recall': 0.9950078003120125, 'f1': 0.9968740231322288, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9961 | 0.9963 | 0.9962 | 0.9978 |
| 0.0081 | 4.84 | 4400 | 0.0116 | {'precision': 0.9988161010260458, 'recall': 0.9980283911671924, 'f1': 0.998422090729783, 'number': 7608} | {'precision': 0.9984131182226924, 'recall': 0.9985451659833355, 'f1': 0.9984791377372215, 'number': 7561} | {'precision': 0.9886621315192744, 'recall': 0.9781267526640494, 'f1': 0.9833662249788554, 'number': 1783} | {'precision': 0.9800693240901213, 'recall': 0.9921052631578947, 'f1': 0.986050566695728, 'number': 1140} | {'precision': 0.9962570180910792, 'recall': 0.9965678627145086, 'f1': 0.9964124161597255, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9967 | 0.9963 | 0.9965 | 0.9979 |
| 0.008 | 5.05 | 4600 | 0.0134 | {'precision': 0.9994738226782426, 'recall': 0.9986855941114616, 'f1': 0.9990795529257067, 'number': 7608} | {'precision': 0.9943309162821358, 'recall': 0.9974871048803068, 'f1': 0.9959065099696289, 'number': 7561} | {'precision': 0.9931623931623932, 'recall': 0.9775659001682557, 'f1': 0.9853024307518372, 'number': 1783} | {'precision': 0.9783737024221453, 'recall': 0.9921052631578947, 'f1': 0.985191637630662, 'number': 1140} | {'precision': 0.9987421383647799, 'recall': 0.9909516380655227, 'f1': 0.9948316366483946, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9962 | 0.9954 | 0.9958 | 0.9974 |
| 0.007 | 5.27 | 4800 | 0.0148 | {'precision': 0.9978955675391293, 'recall': 0.9972397476340694, 'f1': 0.9975675497994873, 'number': 7608} | {'precision': 0.9988090512107979, 'recall': 0.9982806507075783, 'f1': 0.9985447810556951, 'number': 7561} | {'precision': 0.9718232044198895, 'recall': 0.9865395401009535, 'f1': 0.9791260784859448, 'number': 1783} | {'precision': 0.9891696750902527, 'recall': 0.9614035087719298, 'f1': 0.9750889679715302, 'number': 1140} | {'precision': 0.9971901342491414, 'recall': 0.9965678627145086, 'f1': 0.9968789013732835, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9958 | 0.9951 | 0.9954 | 0.9972 |
| 0.0046 | 5.49 | 5000 | 0.0110 | {'precision': 0.9986849026827985, 'recall': 0.9981598317560463, 'f1': 0.998422298185643, 'number': 7608} | {'precision': 0.9976218787158145, 'recall': 0.9986774236212141, 'f1': 0.9981493721083939, 'number': 7561} | {'precision': 0.9926303854875284, 'recall': 0.9820527201346047, 'f1': 0.9873132224414999, 'number': 1783} | {'precision': 0.983435047951177, 'recall': 0.9894736842105263, 'f1': 0.9864451246174027, 'number': 1140} | {'precision': 0.9981244138793373, 'recall': 0.9962558502340093, 'f1': 0.9971892567145534, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9971 | 0.9965 | 0.9968 | 0.9980 |
| 0.0029 | 5.71 | 5200 | 0.0095 | {'precision': 0.9994738918847823, 'recall': 0.9988170347003155, 'f1': 0.999145355334955, 'number': 7608} | {'precision': 0.9980150853513299, 'recall': 0.9974871048803068, 'f1': 0.9977510252678925, 'number': 7561} | {'precision': 0.9887260428410372, 'recall': 0.9837352776219854, 'f1': 0.9862243463592916, 'number': 1783} | {'precision': 0.9834926151172894, 'recall': 0.9929824561403509, 'f1': 0.9882147533828022, 'number': 1140} | {'precision': 0.9959514170040485, 'recall': 0.9978159126365055, 'f1': 0.9968827930174563, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9969 | 0.9969 | 0.9969 | 0.9981 |
| 0.0031 | 5.93 | 5400 | 0.0126 | {'precision': 0.9993421052631579, 'recall': 0.9982912723449001, 'f1': 0.9988164124145186, 'number': 7608} | {'precision': 0.9969600845889506, 'recall': 0.9976193625181854, 'f1': 0.997289614596417, 'number': 7561} | {'precision': 0.988135593220339, 'recall': 0.9809310151430174, 'f1': 0.9845201238390092, 'number': 1783} | {'precision': 0.9920844327176781, 'recall': 0.9894736842105263, 'f1': 0.9907773386034255, 'number': 1140} | {'precision': 0.9971910112359551, 'recall': 0.9968798751950078, 'f1': 0.9970354189421127, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9971 | 0.9962 | 0.9967 | 0.9980 |
| 0.0043 | 6.15 | 5600 | 0.0122 | {'precision': 0.9989479221462388, 'recall': 0.998422712933754, 'f1': 0.9986852484880357, 'number': 7608} | {'precision': 0.9977489406779662, 'recall': 0.9965613014151568, 'f1': 0.9971547674187785, 'number': 7561} | {'precision': 0.9815126050420168, 'recall': 0.9826135726303982, 'f1': 0.9820627802690582, 'number': 1783} | {'precision': 0.9921121822962313, 'recall': 0.9929824561403509, 'f1': 0.9925471284524331, 'number': 1140} | {'precision': 0.9937849596022374, 'recall': 0.9978159126365055, 'f1': 0.9957963568425969, 'number': 3205} | {'precision': 0.998393144081414, 'recall': 0.9989281886387996, 'f1': 0.998660594695955, 'number': 1866} | 0.9961 | 0.9963 | 0.9962 | 0.9978 |
| 0.0048 | 6.37 | 5800 | 0.0162 | {'precision': 0.9994733377221856, 'recall': 0.9977655099894848, 'f1': 0.9986186936788791, 'number': 7608} | {'precision': 0.9978849966953074, 'recall': 0.9984129083454569, 'f1': 0.998148882718498, 'number': 7561} | {'precision': 0.9837352776219854, 'recall': 0.9837352776219854, 'f1': 0.9837352776219854, 'number': 1783} | {'precision': 0.9911816578483245, 'recall': 0.9859649122807017, 'f1': 0.988566402814424, 'number': 1140} | {'precision': 0.9959451029320024, 'recall': 0.9962558502340093, 'f1': 0.9961004523475275, 'number': 3205} | {'precision': 0.9989293361884368, 'recall': 1.0, 'f1': 0.9994643813604713, 'number': 1866} | 0.9968 | 0.9963 | 0.9965 | 0.9978 |
| 0.0035 | 6.59 | 6000 | 0.0137 | {'precision': 0.9989477837695646, 'recall': 0.9982912723449001, 'f1': 0.9986194201564658, 'number': 7608} | {'precision': 0.9978849966953074, 'recall': 0.9984129083454569, 'f1': 0.998148882718498, 'number': 7561} | {'precision': 0.9909553420011306, 'recall': 0.9831744251261918, 'f1': 0.9870495495495496, 'number': 1783} | {'precision': 0.982713915298185, 'recall': 0.9973684210526316, 'f1': 0.9899869394862865, 'number': 1140} | {'precision': 0.99812382739212, 'recall': 0.9959438377535101, 'f1': 0.9970326409495549, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9972 | 0.9969 | 0.9970 | 0.9982 |
| 0.0018 | 6.81 | 6200 | 0.0156 | {'precision': 0.9977655099894848, 'recall': 0.9977655099894848, 'f1': 0.9977655099894848, 'number': 7608} | {'precision': 0.9977539965649359, 'recall': 0.9988096812590928, 'f1': 0.9982815598149374, 'number': 7561} | {'precision': 0.9887260428410372, 'recall': 0.9837352776219854, 'f1': 0.9862243463592916, 'number': 1783} | {'precision': 0.9858906525573192, 'recall': 0.980701754385965, 'f1': 0.9832893579595425, 'number': 1140} | {'precision': 0.9975007810059356, 'recall': 0.9962558502340093, 'f1': 0.9968779269434904, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9966 | 0.9962 | 0.9964 | 0.9978 |
| 0.0026 | 7.03 | 6400 | 0.0155 | {'precision': 0.9990784623486045, 'recall': 0.9975026288117771, 'f1': 0.9982899237042884, 'number': 7608} | {'precision': 0.9976218787158145, 'recall': 0.9986774236212141, 'f1': 0.9981493721083939, 'number': 7561} | {'precision': 0.9859865470852018, 'recall': 0.9865395401009535, 'f1': 0.9862629660779366, 'number': 1783} | {'precision': 0.9843342036553525, 'recall': 0.9921052631578947, 'f1': 0.9882044560943644, 'number': 1140} | {'precision': 0.9987464744594171, 'recall': 0.9943837753510141, 'f1': 0.9965603502188868, 'number': 3205} | {'precision': 0.9946695095948828, 'recall': 1.0, 'f1': 0.997327632282202, 'number': 1866} | 0.9965 | 0.9965 | 0.9965 | 0.9978 |
| 0.0065 | 7.25 | 6600 | 0.0134 | {'precision': 0.9997368767267465, 'recall': 0.9988170347003155, 'f1': 0.9992767440331382, 'number': 7608} | {'precision': 0.9985453583708014, 'recall': 0.9986774236212141, 'f1': 0.998611386629637, 'number': 7561} | {'precision': 0.9843312814773363, 'recall': 0.9865395401009535, 'f1': 0.9854341736694678, 'number': 1783} | {'precision': 0.9894273127753304, 'recall': 0.9850877192982456, 'f1': 0.9872527472527471, 'number': 1140} | {'precision': 0.9968827930174564, 'recall': 0.9978159126365055, 'f1': 0.9973491345704039, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9972 | 0.9971 | 0.9972 | 0.9982 |
| 0.003 | 7.47 | 6800 | 0.0112 | {'precision': 0.9996053150901197, 'recall': 0.9986855941114616, 'f1': 0.9991452429482544, 'number': 7608} | {'precision': 0.996829171621086, 'recall': 0.9978838777939426, 'f1': 0.9973562458691342, 'number': 7561} | {'precision': 0.9903791737408036, 'recall': 0.981491867638811, 'f1': 0.9859154929577465, 'number': 1783} | {'precision': 0.9835497835497835, 'recall': 0.9964912280701754, 'f1': 0.9899782135076253, 'number': 1140} | {'precision': 0.9981244138793373, 'recall': 0.9962558502340093, 'f1': 0.9971892567145534, 'number': 3205} | {'precision': 0.9994640943193998, 'recall': 0.9994640943193998, 'f1': 0.9994640943193998, 'number': 1866} | 0.9970 | 0.9967 | 0.9968 | 0.9981 |
| 0.0023 | 7.69 | 7000 | 0.0106 | {'precision': 0.999473753453493, 'recall': 0.9985541535226078, 'f1': 0.9990137418633703, 'number': 7608} | {'precision': 0.9956424138386373, 'recall': 0.9972225896045497, 'f1': 0.9964318752477865, 'number': 7561} | {'precision': 0.9903791737408036, 'recall': 0.981491867638811, 'f1': 0.9859154929577465, 'number': 1783} | {'precision': 0.9895287958115183, 'recall': 0.9947368421052631, 'f1': 0.9921259842519685, 'number': 1140} | {'precision': 0.9984355444305382, 'recall': 0.995631825273011, 'f1': 0.9970317137947196, 'number': 3205} | {'precision': 0.9994640943193998, 'recall': 0.9994640943193998, 'f1': 0.9994640943193998, 'number': 1866} | 0.9969 | 0.9963 | 0.9966 | 0.9980 |
| 0.0011 | 7.91 | 7200 | 0.0102 | {'precision': 0.9997369113391212, 'recall': 0.9989484752891693, 'f1': 0.9993425378040762, 'number': 7608} | {'precision': 0.9969624933967248, 'recall': 0.9984129083454569, 'f1': 0.9976871737262935, 'number': 7561} | {'precision': 0.9915062287655719, 'recall': 0.9820527201346047, 'f1': 0.9867568329106791, 'number': 1783} | {'precision': 0.9852813852813853, 'recall': 0.9982456140350877, 'f1': 0.9917211328976034, 'number': 1140} | {'precision': 0.99812382739212, 'recall': 0.9959438377535101, 'f1': 0.9970326409495549, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9973 | 0.9971 | 0.9972 | 0.9983 |
| 0.002 | 8.13 | 7400 | 0.0106 | {'precision': 0.9996054189135868, 'recall': 0.9989484752891693, 'f1': 0.9992768391295773, 'number': 7608} | {'precision': 0.9973562458691342, 'recall': 0.9978838777939426, 'f1': 0.9976199920666402, 'number': 7561} | {'precision': 0.9870495495495496, 'recall': 0.9831744251261918, 'f1': 0.9851081764540602, 'number': 1783} | {'precision': 0.9860869565217392, 'recall': 0.9947368421052631, 'f1': 0.9903930131004367, 'number': 1140} | {'precision': 0.9975007810059356, 'recall': 0.9962558502340093, 'f1': 0.9968779269434904, 'number': 3205} | {'precision': 0.9994640943193998, 'recall': 0.9994640943193998, 'f1': 0.9994640943193998, 'number': 1866} | 0.9969 | 0.9968 | 0.9969 | 0.9981 |
| 0.0009 | 8.35 | 7600 | 0.0112 | {'precision': 0.999605367008682, 'recall': 0.9988170347003155, 'f1': 0.9992110453648916, 'number': 7608} | {'precision': 0.9977531060005287, 'recall': 0.9984129083454569, 'f1': 0.9980828981291731, 'number': 7561} | {'precision': 0.988155668358714, 'recall': 0.9826135726303982, 'f1': 0.9853768278965129, 'number': 1783} | {'precision': 0.987794245858762, 'recall': 0.993859649122807, 'f1': 0.9908176650634019, 'number': 1140} | {'precision': 0.9959476309226932, 'recall': 0.9968798751950078, 'f1': 0.9964135350070169, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9970 | 0.9970 | 0.9970 | 0.9982 |
| 0.0006 | 8.57 | 7800 | 0.0115 | {'precision': 0.999605367008682, 'recall': 0.9988170347003155, 'f1': 0.9992110453648916, 'number': 7608} | {'precision': 0.9985453583708014, 'recall': 0.9986774236212141, 'f1': 0.998611386629637, 'number': 7561} | {'precision': 0.9904117315284828, 'recall': 0.9848569826135727, 'f1': 0.9876265466816648, 'number': 1783} | {'precision': 0.9869678540399652, 'recall': 0.9964912280701754, 'f1': 0.9917066783064163, 'number': 1140} | {'precision': 0.9971945137157108, 'recall': 0.9981279251170047, 'f1': 0.9976610010915329, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9976 | 0.9976 | 0.9976 | 0.9985 |
| 0.0005 | 8.79 | 8000 | 0.0135 | {'precision': 0.9997369113391212, 'recall': 0.9989484752891693, 'f1': 0.9993425378040762, 'number': 7608} | {'precision': 0.9982795129698253, 'recall': 0.9976193625181854, 'f1': 0.9979493285704836, 'number': 7561} | {'precision': 0.984313725490196, 'recall': 0.9854178351093662, 'f1': 0.9848654708520179, 'number': 1783} | {'precision': 0.987783595113438, 'recall': 0.9929824561403509, 'f1': 0.9903762029746283, 'number': 1140} | {'precision': 0.9968837644125896, 'recall': 0.9981279251170047, 'f1': 0.9975054568132211, 'number': 3205} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1866} | 0.9971 | 0.9972 | 0.9971 | 0.9983 |
| 0.0025 | 9.01 | 8200 | 0.0119 | {'precision': 0.9997368767267465, 'recall': 0.9988170347003155, 'f1': 0.9992767440331382, 'number': 7608} | {'precision': 0.9978852762357917, 'recall': 0.9985451659833355, 'f1': 0.998215112051299, 'number': 7561} | {'precision': 0.9854504756575265, 'recall': 0.9876612450925406, 'f1': 0.9865546218487395, 'number': 1783} | {'precision': 0.989492119089317, 'recall': 0.9912280701754386, 'f1': 0.9903593339176161, 'number': 1140} | {'precision': 0.9984365228267668, 'recall': 0.9962558502340093, 'f1': 0.9973449945338122, 'number': 3205} | {'precision': 0.9994643813604713, 'recall': 1.0, 'f1': 0.999732118939191, 'number': 1866} | 0.9973 | 0.9972 | 0.9973 | 0.9982 |
| 0.0006 | 9.23 | 8400 | 0.0148 | {'precision': 0.9992106301802395, 'recall': 0.9982912723449001, 'f1': 0.9987507396936025, 'number': 7608} | {'precision': 0.9978858350951374, 'recall': 0.9988096812590928, 'f1': 0.9983475444510542, 'number': 7561} | {'precision': 0.9898477157360406, 'recall': 0.9842961301177791, 'f1': 0.9870641169853769, 'number': 1783} | {'precision': 0.9860990443092963, 'recall': 0.9956140350877193, 'f1': 0.9908336970755128, 'number': 1140} | {'precision': 0.9978125, 'recall': 0.9962558502340093, 'f1': 0.9970335675253708, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9972 | 0.9971 | 0.9971 | 0.9981 |
| 0.0005 | 9.45 | 8600 | 0.0150 | {'precision': 0.9990793107983691, 'recall': 0.998422712933754, 'f1': 0.998750903951088, 'number': 7608} | {'precision': 0.997885555702392, 'recall': 0.9986774236212141, 'f1': 0.998281332628239, 'number': 7561} | {'precision': 0.9898305084745763, 'recall': 0.9826135726303982, 'f1': 0.9862088376020265, 'number': 1783} | {'precision': 0.9852430555555556, 'recall': 0.9956140350877193, 'f1': 0.9904013961605583, 'number': 1140} | {'precision': 0.9978125, 'recall': 0.9962558502340093, 'f1': 0.9970335675253708, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9971 | 0.9970 | 0.9970 | 0.9980 |
| 0.0005 | 9.67 | 8800 | 0.0145 | {'precision': 0.9993421918168662, 'recall': 0.998422712933754, 'f1': 0.9988822407784864, 'number': 7608} | {'precision': 0.9977534029337914, 'recall': 0.9985451659833355, 'f1': 0.9981491274457958, 'number': 7561} | {'precision': 0.9898305084745763, 'recall': 0.9826135726303982, 'f1': 0.9862088376020265, 'number': 1783} | {'precision': 0.9844020797227037, 'recall': 0.9964912280701754, 'f1': 0.990409764603313, 'number': 1140} | {'precision': 0.9978125, 'recall': 0.9962558502340093, 'f1': 0.9970335675253708, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9971 | 0.9970 | 0.9970 | 0.9980 |
| 0.0018 | 9.89 | 9000 | 0.0128 | {'precision': 0.9993421052631579, 'recall': 0.9982912723449001, 'f1': 0.9988164124145186, 'number': 7608} | {'precision': 0.9989415189203493, 'recall': 0.9985451659833355, 'f1': 0.9987433031285138, 'number': 7561} | {'precision': 0.9887387387387387, 'recall': 0.9848569826135727, 'f1': 0.9867940432705816, 'number': 1783} | {'precision': 0.9869451697127938, 'recall': 0.9947368421052631, 'f1': 0.9908256880733946, 'number': 1140} | {'precision': 0.9965732087227415, 'recall': 0.9981279251170047, 'f1': 0.9973499610288388, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9973 | 0.9973 | 0.9973 | 0.9983 |
| 0.0013 | 10.11 | 9200 | 0.0130 | {'precision': 0.9994736842105263, 'recall': 0.998422712933754, 'f1': 0.9989479221462388, 'number': 7608} | {'precision': 0.9984135378106822, 'recall': 0.9988096812590928, 'f1': 0.9986115702479339, 'number': 7561} | {'precision': 0.9909706546275395, 'recall': 0.9848569826135727, 'f1': 0.9879043600562588, 'number': 1783} | {'precision': 0.9869678540399652, 'recall': 0.9964912280701754, 'f1': 0.9917066783064163, 'number': 1140} | {'precision': 0.9975039001560062, 'recall': 0.9975039001560062, 'f1': 0.9975039001560062, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9975 | 0.9974 | 0.9975 | 0.9983 |
| 0.0008 | 10.33 | 9400 | 0.0133 | {'precision': 0.9994736149493354, 'recall': 0.9982912723449001, 'f1': 0.9988820937726047, 'number': 7608} | {'precision': 0.9978858350951374, 'recall': 0.9988096812590928, 'f1': 0.9983475444510542, 'number': 7561} | {'precision': 0.9909655561829475, 'recall': 0.9842961301177791, 'f1': 0.9876195835678109, 'number': 1783} | {'precision': 0.9852558542931483, 'recall': 0.9964912280701754, 'f1': 0.9908416921064109, 'number': 1140} | {'precision': 0.9975007810059356, 'recall': 0.9962558502340093, 'f1': 0.9968779269434904, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9972 | 0.9972 | 0.9972 | 0.9981 |
| 0.0002 | 10.55 | 9600 | 0.0135 | {'precision': 0.9994736842105263, 'recall': 0.998422712933754, 'f1': 0.9989479221462388, 'number': 7608} | {'precision': 0.9980177084709925, 'recall': 0.9988096812590928, 'f1': 0.9984135378106822, 'number': 7561} | {'precision': 0.9909655561829475, 'recall': 0.9842961301177791, 'f1': 0.9876195835678109, 'number': 1783} | {'precision': 0.9861111111111112, 'recall': 0.9964912280701754, 'f1': 0.9912739965095986, 'number': 1140} | {'precision': 0.9975015615240475, 'recall': 0.9965678627145086, 'f1': 0.9970344935227097, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9973 | 0.9972 | 0.9973 | 0.9982 |
| 0.0006 | 10.77 | 9800 | 0.0132 | {'precision': 0.9994736842105263, 'recall': 0.998422712933754, 'f1': 0.9989479221462388, 'number': 7608} | {'precision': 0.9981496167063177, 'recall': 0.9988096812590928, 'f1': 0.998479539895551, 'number': 7561} | {'precision': 0.9909706546275395, 'recall': 0.9848569826135727, 'f1': 0.9879043600562588, 'number': 1783} | {'precision': 0.9869678540399652, 'recall': 0.9964912280701754, 'f1': 0.9917066783064163, 'number': 1140} | {'precision': 0.9975023415547923, 'recall': 0.9968798751950078, 'f1': 0.997191011235955, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9974 | 0.9973 | 0.9974 | 0.9983 |
| 0.0004 | 10.99 | 10000 | 0.0132 | {'precision': 0.9994736842105263, 'recall': 0.998422712933754, 'f1': 0.9989479221462388, 'number': 7608} | {'precision': 0.9981496167063177, 'recall': 0.9988096812590928, 'f1': 0.998479539895551, 'number': 7561} | {'precision': 0.9909706546275395, 'recall': 0.9848569826135727, 'f1': 0.9879043600562588, 'number': 1783} | {'precision': 0.9869678540399652, 'recall': 0.9964912280701754, 'f1': 0.9917066783064163, 'number': 1140} | {'precision': 0.9975023415547923, 'recall': 0.9968798751950078, 'f1': 0.997191011235955, 'number': 3205} | {'precision': 0.9983948635634029, 'recall': 1.0, 'f1': 0.9991967871485944, 'number': 1866} | 0.9974 | 0.9973 | 0.9974 | 0.9983 |
### Framework versions
- Transformers 4.38.2
- Pytorch 2.0.1+cu118
- Datasets 2.18.0
- Tokenizers 0.15.2
|