File size: 37,269 Bytes
1355271 de3d7c0 1355271 de3d7c0 1355271 de3d7c0 1355271 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 |
---
license: apache-2.0
base_model: SenseTime/deformable-detr
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: sensetime-deformable-detr-finetuned-10k-cppe5-manual-pad
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/qubvel-hf-co/transformers-detection-model-finetuning-cppe5/runs/tqbxv4bu)
# sensetime-deformable-detr-finetuned-10k-cppe5-manual-pad
This model is a fine-tuned version of [SenseTime/deformable-detr](https://huggingface.co/SenseTime/deformable-detr) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.0256
- Map: 0.3589
- Map 50: 0.6477
- Map 75: 0.3379
- Map Small: 0.2489
- Map Medium: 0.3004
- Map Large: 0.5406
- Mar 1: 0.321
- Mar 10: 0.4947
- Mar 100: 0.5174
- Mar Small: 0.3113
- Mar Medium: 0.4731
- Mar Large: 0.7397
- Map Coverall: 0.5964
- Mar 100 Coverall: 0.6878
- Map Face Shield: 0.3426
- Mar 100 Face Shield: 0.5165
- Map Gloves: 0.2892
- Mar 100 Gloves: 0.4808
- Map Goggles: 0.2237
- Mar 100 Goggles: 0.4215
- Map Mask: 0.3424
- Mar 100 Mask: 0.4804
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 4
- eval_batch_size: 8
- seed: 1337
- gradient_accumulation_steps: 2
- total_train_batch_size: 8
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-------:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 10.3619 | 0.9953 | 106 | 1.7279 | 0.0225 | 0.0532 | 0.0173 | 0.0105 | 0.0222 | 0.0573 | 0.0545 | 0.2021 | 0.256 | 0.0886 | 0.1921 | 0.4563 | 0.058 | 0.5185 | 0.005 | 0.1911 | 0.0065 | 0.1527 | 0.0014 | 0.1031 | 0.0414 | 0.3147 |
| 1.4739 | 2.0 | 213 | 1.4628 | 0.0652 | 0.1399 | 0.0556 | 0.03 | 0.0507 | 0.0609 | 0.1029 | 0.2575 | 0.2994 | 0.1354 | 0.2409 | 0.4374 | 0.1909 | 0.6099 | 0.0031 | 0.1051 | 0.0138 | 0.3013 | 0.0005 | 0.08 | 0.1179 | 0.4009 |
| 1.3224 | 2.9953 | 319 | 1.3720 | 0.0748 | 0.1535 | 0.0619 | 0.0307 | 0.0474 | 0.0966 | 0.1166 | 0.2946 | 0.343 | 0.133 | 0.2939 | 0.5098 | 0.2402 | 0.6568 | 0.0051 | 0.1392 | 0.0196 | 0.3326 | 0.0027 | 0.1754 | 0.1063 | 0.4111 |
| 1.2103 | 4.0 | 426 | 1.3367 | 0.1059 | 0.2158 | 0.0965 | 0.0558 | 0.0848 | 0.1611 | 0.134 | 0.3451 | 0.3827 | 0.2024 | 0.3102 | 0.5769 | 0.2661 | 0.6581 | 0.0084 | 0.2405 | 0.0415 | 0.3679 | 0.009 | 0.2338 | 0.2044 | 0.4133 |
| 1.1512 | 4.9953 | 532 | 1.3017 | 0.1104 | 0.2303 | 0.0989 | 0.0497 | 0.0911 | 0.1485 | 0.1493 | 0.3385 | 0.3902 | 0.2218 | 0.3327 | 0.488 | 0.2878 | 0.6739 | 0.0264 | 0.2658 | 0.0413 | 0.3214 | 0.0083 | 0.2538 | 0.1881 | 0.436 |
| 1.1269 | 6.0 | 639 | 1.2189 | 0.1505 | 0.3037 | 0.1347 | 0.0673 | 0.1251 | 0.2218 | 0.188 | 0.3968 | 0.4363 | 0.2876 | 0.3799 | 0.6076 | 0.3635 | 0.6617 | 0.0443 | 0.3418 | 0.0786 | 0.3812 | 0.0241 | 0.3508 | 0.2419 | 0.4458 |
| 1.0859 | 6.9953 | 745 | 1.1980 | 0.1635 | 0.3138 | 0.1478 | 0.0766 | 0.1364 | 0.2544 | 0.2051 | 0.4075 | 0.443 | 0.2827 | 0.3627 | 0.63 | 0.3806 | 0.6757 | 0.0464 | 0.3848 | 0.1133 | 0.4161 | 0.042 | 0.3108 | 0.2353 | 0.4276 |
| 1.0439 | 8.0 | 852 | 1.2446 | 0.172 | 0.3484 | 0.1511 | 0.0858 | 0.1464 | 0.2721 | 0.2275 | 0.4135 | 0.4428 | 0.2567 | 0.3911 | 0.6221 | 0.3777 | 0.6324 | 0.0758 | 0.4316 | 0.1172 | 0.3683 | 0.0781 | 0.3492 | 0.2113 | 0.4324 |
| 1.017 | 8.9953 | 958 | 1.1637 | 0.2129 | 0.4062 | 0.1987 | 0.1132 | 0.1806 | 0.3477 | 0.2496 | 0.4392 | 0.4664 | 0.3248 | 0.3972 | 0.6474 | 0.4423 | 0.6568 | 0.0842 | 0.4772 | 0.1564 | 0.429 | 0.1188 | 0.3323 | 0.2628 | 0.4369 |
| 0.9767 | 10.0 | 1065 | 1.1269 | 0.2289 | 0.4432 | 0.2126 | 0.1015 | 0.1906 | 0.3867 | 0.258 | 0.4482 | 0.4827 | 0.313 | 0.407 | 0.6946 | 0.4614 | 0.6721 | 0.1122 | 0.4582 | 0.1489 | 0.4237 | 0.1467 | 0.4062 | 0.275 | 0.4533 |
| 0.9644 | 10.9953 | 1171 | 1.1110 | 0.2232 | 0.4358 | 0.2044 | 0.1075 | 0.1857 | 0.3961 | 0.2573 | 0.4596 | 0.494 | 0.3017 | 0.4296 | 0.7159 | 0.4789 | 0.6838 | 0.1002 | 0.4747 | 0.1636 | 0.4362 | 0.1119 | 0.4231 | 0.2615 | 0.4524 |
| 0.913 | 12.0 | 1278 | 1.0962 | 0.2356 | 0.4489 | 0.2203 | 0.103 | 0.1966 | 0.4016 | 0.2502 | 0.4601 | 0.4872 | 0.2891 | 0.436 | 0.6815 | 0.5056 | 0.6982 | 0.1232 | 0.4924 | 0.1684 | 0.4357 | 0.0934 | 0.3708 | 0.2871 | 0.4387 |
| 0.9137 | 12.9953 | 1384 | 1.0738 | 0.2611 | 0.5029 | 0.2452 | 0.1286 | 0.217 | 0.4447 | 0.2697 | 0.4713 | 0.4999 | 0.3139 | 0.4332 | 0.709 | 0.5015 | 0.6793 | 0.1089 | 0.4722 | 0.2106 | 0.4375 | 0.1568 | 0.4108 | 0.3275 | 0.5 |
| 0.8912 | 14.0 | 1491 | 1.0759 | 0.2507 | 0.4762 | 0.2409 | 0.1312 | 0.2104 | 0.3983 | 0.2567 | 0.466 | 0.4975 | 0.301 | 0.4542 | 0.6846 | 0.5117 | 0.6793 | 0.121 | 0.4759 | 0.1978 | 0.4549 | 0.1248 | 0.4154 | 0.2983 | 0.4618 |
| 0.8813 | 14.9953 | 1597 | 1.0867 | 0.2671 | 0.5024 | 0.2477 | 0.1271 | 0.2056 | 0.4606 | 0.2821 | 0.4668 | 0.498 | 0.2959 | 0.4313 | 0.7065 | 0.495 | 0.6662 | 0.1419 | 0.4873 | 0.2163 | 0.4429 | 0.1562 | 0.4185 | 0.3258 | 0.4751 |
| 0.8498 | 16.0 | 1704 | 1.0624 | 0.2666 | 0.4992 | 0.2419 | 0.1318 | 0.2283 | 0.4244 | 0.2798 | 0.4744 | 0.5083 | 0.3305 | 0.4576 | 0.6703 | 0.5405 | 0.7099 | 0.1325 | 0.4734 | 0.2057 | 0.4616 | 0.1513 | 0.4231 | 0.3028 | 0.4733 |
| 0.8483 | 16.9953 | 1810 | 1.0820 | 0.2787 | 0.5205 | 0.257 | 0.1461 | 0.2308 | 0.4503 | 0.277 | 0.4735 | 0.5036 | 0.299 | 0.4551 | 0.7175 | 0.5263 | 0.6694 | 0.1694 | 0.5241 | 0.227 | 0.4576 | 0.1581 | 0.3908 | 0.3125 | 0.4764 |
| 0.8221 | 18.0 | 1917 | 1.0451 | 0.2898 | 0.5404 | 0.2682 | 0.1397 | 0.2366 | 0.4668 | 0.2939 | 0.48 | 0.5125 | 0.3176 | 0.458 | 0.7227 | 0.5524 | 0.6968 | 0.1792 | 0.5152 | 0.2346 | 0.4781 | 0.1728 | 0.4077 | 0.31 | 0.4649 |
| 0.817 | 18.9953 | 2023 | 1.0584 | 0.2903 | 0.5527 | 0.2735 | 0.1519 | 0.24 | 0.4737 | 0.2861 | 0.4794 | 0.505 | 0.3191 | 0.4526 | 0.7091 | 0.549 | 0.6694 | 0.1764 | 0.4848 | 0.2235 | 0.4777 | 0.1855 | 0.4246 | 0.3169 | 0.4684 |
| 0.8036 | 20.0 | 2130 | 1.0191 | 0.3035 | 0.5578 | 0.2858 | 0.1533 | 0.2573 | 0.4706 | 0.3007 | 0.4967 | 0.5268 | 0.3419 | 0.4752 | 0.7306 | 0.556 | 0.6986 | 0.1763 | 0.4835 | 0.2276 | 0.4835 | 0.2162 | 0.4646 | 0.3416 | 0.5036 |
| 0.8123 | 20.9953 | 2236 | 1.0379 | 0.2956 | 0.5485 | 0.2926 | 0.1558 | 0.2456 | 0.4422 | 0.2803 | 0.4779 | 0.505 | 0.3013 | 0.4454 | 0.7074 | 0.5456 | 0.6986 | 0.1876 | 0.5127 | 0.2409 | 0.4661 | 0.1753 | 0.3923 | 0.3286 | 0.4556 |
| 0.7754 | 22.0 | 2343 | 1.0195 | 0.3091 | 0.5753 | 0.2991 | 0.1525 | 0.2596 | 0.4994 | 0.296 | 0.4842 | 0.5152 | 0.3251 | 0.4625 | 0.7229 | 0.5486 | 0.691 | 0.2008 | 0.4861 | 0.2483 | 0.4763 | 0.1959 | 0.4323 | 0.3517 | 0.4902 |
| 0.7821 | 22.9953 | 2449 | 1.0281 | 0.2914 | 0.5489 | 0.2729 | 0.1621 | 0.2336 | 0.4759 | 0.2881 | 0.4763 | 0.5031 | 0.3216 | 0.4401 | 0.7231 | 0.5475 | 0.6896 | 0.145 | 0.438 | 0.2342 | 0.4826 | 0.1773 | 0.4231 | 0.353 | 0.4822 |
| 0.7728 | 24.0 | 2556 | 1.0187 | 0.3027 | 0.5771 | 0.2814 | 0.162 | 0.2508 | 0.4894 | 0.3055 | 0.4753 | 0.5031 | 0.313 | 0.4452 | 0.7223 | 0.5602 | 0.6901 | 0.167 | 0.4544 | 0.2421 | 0.4746 | 0.2045 | 0.4262 | 0.3396 | 0.4702 |
| 0.7626 | 24.9953 | 2662 | 1.0174 | 0.3098 | 0.582 | 0.287 | 0.155 | 0.256 | 0.4802 | 0.298 | 0.479 | 0.5049 | 0.3115 | 0.4508 | 0.7075 | 0.5626 | 0.7023 | 0.2061 | 0.481 | 0.2438 | 0.4705 | 0.2022 | 0.3985 | 0.3341 | 0.472 |
| 0.7373 | 26.0 | 2769 | 1.0243 | 0.3095 | 0.5691 | 0.29 | 0.1705 | 0.2648 | 0.4646 | 0.2906 | 0.4849 | 0.5122 | 0.3266 | 0.4652 | 0.6931 | 0.5707 | 0.7045 | 0.2093 | 0.4899 | 0.2371 | 0.4848 | 0.1857 | 0.4031 | 0.3449 | 0.4787 |
| 0.7417 | 26.9953 | 2875 | 1.0274 | 0.302 | 0.57 | 0.2822 | 0.1566 | 0.2621 | 0.4879 | 0.2855 | 0.4846 | 0.5098 | 0.3007 | 0.4661 | 0.7126 | 0.561 | 0.6865 | 0.1538 | 0.4582 | 0.2606 | 0.4987 | 0.1863 | 0.4138 | 0.3483 | 0.492 |
| 0.7342 | 28.0 | 2982 | 1.0251 | 0.3111 | 0.5698 | 0.301 | 0.2027 | 0.264 | 0.5177 | 0.2992 | 0.484 | 0.5101 | 0.2979 | 0.4723 | 0.7202 | 0.5803 | 0.705 | 0.2111 | 0.5051 | 0.26 | 0.4772 | 0.1731 | 0.3954 | 0.331 | 0.468 |
| 0.7245 | 28.9953 | 3088 | 1.0225 | 0.3191 | 0.5929 | 0.3104 | 0.1477 | 0.2687 | 0.5187 | 0.2897 | 0.4849 | 0.5109 | 0.3102 | 0.4674 | 0.7198 | 0.5775 | 0.7 | 0.2194 | 0.4848 | 0.2708 | 0.4911 | 0.2009 | 0.4077 | 0.3268 | 0.4711 |
| 0.7193 | 30.0 | 3195 | 1.0384 | 0.3178 | 0.5825 | 0.2977 | 0.1663 | 0.2784 | 0.5044 | 0.2951 | 0.4786 | 0.5028 | 0.2824 | 0.4703 | 0.7195 | 0.5821 | 0.6977 | 0.2162 | 0.481 | 0.2696 | 0.4853 | 0.1935 | 0.3938 | 0.3277 | 0.456 |
| 0.7145 | 30.9953 | 3301 | 1.0392 | 0.3206 | 0.5841 | 0.3159 | 0.1669 | 0.2713 | 0.5149 | 0.3013 | 0.4787 | 0.5028 | 0.2879 | 0.4594 | 0.7221 | 0.5501 | 0.6788 | 0.2655 | 0.4987 | 0.2645 | 0.4754 | 0.174 | 0.3923 | 0.3489 | 0.4684 |
| 0.6967 | 32.0 | 3408 | 1.0187 | 0.3311 | 0.5973 | 0.3181 | 0.1963 | 0.276 | 0.5302 | 0.3057 | 0.4842 | 0.5146 | 0.3214 | 0.4664 | 0.7222 | 0.5812 | 0.6946 | 0.2491 | 0.4899 | 0.2623 | 0.4826 | 0.1969 | 0.42 | 0.3659 | 0.4858 |
| 0.6852 | 32.9953 | 3514 | 1.0071 | 0.3208 | 0.5865 | 0.3056 | 0.1927 | 0.2709 | 0.5294 | 0.2965 | 0.4829 | 0.5095 | 0.311 | 0.4663 | 0.7143 | 0.5898 | 0.6928 | 0.2473 | 0.4924 | 0.2652 | 0.4938 | 0.169 | 0.4108 | 0.333 | 0.4578 |
| 0.6865 | 34.0 | 3621 | 1.0266 | 0.3295 | 0.6072 | 0.3179 | 0.2337 | 0.2649 | 0.5257 | 0.3041 | 0.4898 | 0.5174 | 0.3385 | 0.4668 | 0.7233 | 0.581 | 0.7041 | 0.2596 | 0.5165 | 0.257 | 0.4714 | 0.2074 | 0.4323 | 0.3427 | 0.4627 |
| 0.6919 | 34.9953 | 3727 | 1.0195 | 0.3286 | 0.5899 | 0.3287 | 0.214 | 0.268 | 0.5207 | 0.3043 | 0.4868 | 0.5144 | 0.3366 | 0.4602 | 0.716 | 0.5766 | 0.6883 | 0.2714 | 0.5228 | 0.2636 | 0.4737 | 0.1783 | 0.4 | 0.3532 | 0.4871 |
| 0.6632 | 36.0 | 3834 | 1.0153 | 0.3286 | 0.6069 | 0.3118 | 0.2139 | 0.2633 | 0.5508 | 0.3016 | 0.4888 | 0.5129 | 0.3289 | 0.4562 | 0.7306 | 0.5759 | 0.695 | 0.2508 | 0.5063 | 0.2628 | 0.4884 | 0.2074 | 0.4092 | 0.3461 | 0.4653 |
| 0.6625 | 36.9953 | 3940 | 1.0160 | 0.3303 | 0.6109 | 0.3231 | 0.2187 | 0.2643 | 0.5163 | 0.3021 | 0.5032 | 0.5249 | 0.3526 | 0.4717 | 0.7264 | 0.579 | 0.7014 | 0.2861 | 0.5456 | 0.255 | 0.475 | 0.1864 | 0.4277 | 0.345 | 0.4751 |
| 0.6384 | 38.0 | 4047 | 1.0206 | 0.3319 | 0.6171 | 0.3115 | 0.2482 | 0.277 | 0.4977 | 0.3004 | 0.4952 | 0.5184 | 0.3486 | 0.463 | 0.7115 | 0.5744 | 0.6919 | 0.283 | 0.5127 | 0.264 | 0.496 | 0.1915 | 0.4138 | 0.3466 | 0.4778 |
| 0.6491 | 38.9953 | 4153 | 1.0093 | 0.3413 | 0.6184 | 0.3241 | 0.2364 | 0.2828 | 0.5436 | 0.3111 | 0.4956 | 0.5191 | 0.3282 | 0.4653 | 0.7401 | 0.5768 | 0.6901 | 0.3012 | 0.5203 | 0.2799 | 0.4973 | 0.1976 | 0.4123 | 0.3507 | 0.4756 |
| 0.6296 | 40.0 | 4260 | 1.0085 | 0.3488 | 0.6356 | 0.338 | 0.2459 | 0.2798 | 0.5485 | 0.3059 | 0.5011 | 0.5226 | 0.3349 | 0.4679 | 0.7303 | 0.5827 | 0.6955 | 0.3228 | 0.5152 | 0.2829 | 0.4924 | 0.1948 | 0.4262 | 0.3607 | 0.4836 |
| 0.6274 | 40.9953 | 4366 | 1.0169 | 0.3419 | 0.6348 | 0.3162 | 0.2261 | 0.2852 | 0.5279 | 0.3021 | 0.4917 | 0.5176 | 0.3198 | 0.4749 | 0.7226 | 0.5775 | 0.6914 | 0.3009 | 0.5051 | 0.2783 | 0.4853 | 0.2087 | 0.4262 | 0.3439 | 0.48 |
| 0.6176 | 42.0 | 4473 | 1.0100 | 0.3461 | 0.632 | 0.3322 | 0.2413 | 0.2749 | 0.5376 | 0.299 | 0.4962 | 0.5205 | 0.3319 | 0.4719 | 0.7114 | 0.5883 | 0.6865 | 0.3158 | 0.5076 | 0.2719 | 0.4853 | 0.2049 | 0.4292 | 0.3496 | 0.4938 |
| 0.6191 | 42.9953 | 4579 | 1.0207 | 0.3312 | 0.616 | 0.3181 | 0.2232 | 0.2624 | 0.5211 | 0.298 | 0.4867 | 0.5094 | 0.3248 | 0.4485 | 0.7131 | 0.5913 | 0.6955 | 0.282 | 0.4848 | 0.2559 | 0.4696 | 0.1788 | 0.4108 | 0.3479 | 0.4862 |
| 0.606 | 44.0 | 4686 | 1.0277 | 0.3427 | 0.6321 | 0.3366 | 0.2273 | 0.2843 | 0.5306 | 0.3063 | 0.4901 | 0.5133 | 0.3353 | 0.4734 | 0.7016 | 0.5891 | 0.6955 | 0.3009 | 0.4924 | 0.2731 | 0.4938 | 0.2122 | 0.4 | 0.3382 | 0.4849 |
| 0.5997 | 44.9953 | 4792 | 1.0328 | 0.3511 | 0.6488 | 0.3383 | 0.2503 | 0.2842 | 0.5437 | 0.3112 | 0.4952 | 0.5172 | 0.3287 | 0.4658 | 0.7137 | 0.5806 | 0.6914 | 0.3212 | 0.5076 | 0.273 | 0.4848 | 0.2281 | 0.4154 | 0.3523 | 0.4867 |
| 0.596 | 46.0 | 4899 | 1.0246 | 0.3407 | 0.6296 | 0.3311 | 0.2184 | 0.2716 | 0.5326 | 0.305 | 0.4896 | 0.5118 | 0.3352 | 0.4454 | 0.7073 | 0.5779 | 0.6779 | 0.3226 | 0.5215 | 0.2642 | 0.4754 | 0.1881 | 0.4046 | 0.3509 | 0.4796 |
| 0.5896 | 46.9953 | 5005 | 1.0360 | 0.3355 | 0.6222 | 0.3106 | 0.2274 | 0.2787 | 0.5188 | 0.3006 | 0.4811 | 0.513 | 0.3173 | 0.4749 | 0.7101 | 0.5686 | 0.6896 | 0.2873 | 0.5152 | 0.2668 | 0.4804 | 0.2071 | 0.4015 | 0.3475 | 0.4782 |
| 0.5683 | 48.0 | 5112 | 1.0115 | 0.3491 | 0.6427 | 0.3348 | 0.2402 | 0.2854 | 0.533 | 0.305 | 0.4998 | 0.5215 | 0.3389 | 0.4717 | 0.7144 | 0.5941 | 0.6847 | 0.3089 | 0.5114 | 0.2777 | 0.4996 | 0.2193 | 0.4277 | 0.3455 | 0.484 |
| 0.5862 | 48.9953 | 5218 | 1.0304 | 0.3398 | 0.6247 | 0.3153 | 0.2517 | 0.2761 | 0.5357 | 0.301 | 0.4936 | 0.5143 | 0.315 | 0.4812 | 0.7167 | 0.5942 | 0.6973 | 0.3179 | 0.5228 | 0.2742 | 0.4844 | 0.1799 | 0.3969 | 0.3329 | 0.4702 |
| 0.5693 | 50.0 | 5325 | 1.0147 | 0.3384 | 0.6251 | 0.3181 | 0.2168 | 0.2743 | 0.5349 | 0.3065 | 0.4863 | 0.5099 | 0.3276 | 0.4629 | 0.7064 | 0.5891 | 0.6932 | 0.3004 | 0.4924 | 0.278 | 0.4888 | 0.175 | 0.3923 | 0.3497 | 0.4827 |
| 0.5746 | 50.9953 | 5431 | 1.0027 | 0.358 | 0.6506 | 0.3568 | 0.2626 | 0.2876 | 0.5381 | 0.3137 | 0.5008 | 0.5167 | 0.3242 | 0.4738 | 0.702 | 0.5917 | 0.6901 | 0.339 | 0.5114 | 0.2929 | 0.492 | 0.2115 | 0.4138 | 0.355 | 0.4764 |
| 0.5472 | 52.0 | 5538 | 1.0248 | 0.3527 | 0.6395 | 0.3431 | 0.2551 | 0.2795 | 0.5491 | 0.3124 | 0.4901 | 0.5122 | 0.3295 | 0.4639 | 0.7153 | 0.5948 | 0.6892 | 0.3158 | 0.5013 | 0.2886 | 0.483 | 0.2132 | 0.4138 | 0.3509 | 0.4738 |
| 0.5494 | 52.9953 | 5644 | 1.0139 | 0.3546 | 0.6379 | 0.3345 | 0.2451 | 0.2955 | 0.5134 | 0.3077 | 0.4996 | 0.5221 | 0.3392 | 0.4822 | 0.7046 | 0.599 | 0.6941 | 0.3065 | 0.5114 | 0.2796 | 0.4879 | 0.2244 | 0.4262 | 0.3634 | 0.4911 |
| 0.5459 | 54.0 | 5751 | 1.0192 | 0.3414 | 0.6262 | 0.3199 | 0.2399 | 0.2849 | 0.5545 | 0.3117 | 0.4918 | 0.5091 | 0.3346 | 0.4602 | 0.7147 | 0.585 | 0.6847 | 0.318 | 0.4873 | 0.2748 | 0.4826 | 0.1721 | 0.3954 | 0.3569 | 0.4956 |
| 0.5449 | 54.9953 | 5857 | 1.0206 | 0.3491 | 0.6486 | 0.3402 | 0.2322 | 0.283 | 0.5474 | 0.3143 | 0.494 | 0.5102 | 0.3231 | 0.4612 | 0.7164 | 0.5941 | 0.6842 | 0.3251 | 0.4975 | 0.2824 | 0.4888 | 0.1974 | 0.3954 | 0.3465 | 0.4849 |
| 0.5268 | 56.0 | 5964 | 1.0073 | 0.3586 | 0.6626 | 0.3397 | 0.2562 | 0.3037 | 0.5633 | 0.3149 | 0.5001 | 0.5204 | 0.3247 | 0.4836 | 0.7085 | 0.5856 | 0.6887 | 0.3472 | 0.5253 | 0.2984 | 0.5071 | 0.2214 | 0.4077 | 0.3401 | 0.4729 |
| 0.5392 | 56.9953 | 6070 | 1.0072 | 0.3575 | 0.6546 | 0.3335 | 0.2564 | 0.2925 | 0.5549 | 0.3203 | 0.4984 | 0.5211 | 0.3359 | 0.4815 | 0.7187 | 0.5905 | 0.691 | 0.3444 | 0.5101 | 0.2957 | 0.5022 | 0.2035 | 0.4077 | 0.3532 | 0.4947 |
| 0.5308 | 58.0 | 6177 | 1.0180 | 0.3551 | 0.6568 | 0.3432 | 0.2456 | 0.2954 | 0.5499 | 0.314 | 0.4931 | 0.5139 | 0.3098 | 0.4698 | 0.7146 | 0.5805 | 0.6757 | 0.3319 | 0.5114 | 0.2966 | 0.492 | 0.2224 | 0.4138 | 0.3443 | 0.4764 |
| 0.5262 | 58.9953 | 6283 | 1.0209 | 0.3516 | 0.6377 | 0.3324 | 0.2479 | 0.2901 | 0.5549 | 0.3184 | 0.487 | 0.5112 | 0.3202 | 0.4589 | 0.7188 | 0.5859 | 0.6865 | 0.3294 | 0.4924 | 0.2931 | 0.4906 | 0.2038 | 0.4077 | 0.346 | 0.4787 |
| 0.5188 | 60.0 | 6390 | 1.0147 | 0.3516 | 0.651 | 0.339 | 0.2243 | 0.2819 | 0.5591 | 0.312 | 0.4897 | 0.5115 | 0.3055 | 0.4666 | 0.7069 | 0.587 | 0.6901 | 0.3318 | 0.5 | 0.3004 | 0.4969 | 0.1964 | 0.3923 | 0.3423 | 0.4782 |
| 0.5205 | 60.9953 | 6496 | 1.0098 | 0.3553 | 0.6521 | 0.3398 | 0.2315 | 0.2949 | 0.5431 | 0.311 | 0.4981 | 0.5216 | 0.3172 | 0.4869 | 0.7172 | 0.5821 | 0.6874 | 0.341 | 0.5228 | 0.304 | 0.5058 | 0.2104 | 0.4123 | 0.3392 | 0.4796 |
| 0.4972 | 62.0 | 6603 | 1.0271 | 0.3542 | 0.6404 | 0.3315 | 0.2293 | 0.2908 | 0.5489 | 0.3194 | 0.4962 | 0.5197 | 0.3165 | 0.4721 | 0.7249 | 0.5844 | 0.6833 | 0.3402 | 0.5228 | 0.2883 | 0.4964 | 0.2107 | 0.4062 | 0.3472 | 0.4898 |
| 0.5169 | 62.9953 | 6709 | 1.0113 | 0.3499 | 0.6355 | 0.3336 | 0.253 | 0.2946 | 0.5515 | 0.3177 | 0.4918 | 0.5152 | 0.3118 | 0.4836 | 0.7148 | 0.5805 | 0.686 | 0.323 | 0.4962 | 0.2999 | 0.5071 | 0.1965 | 0.4 | 0.3494 | 0.4867 |
| 0.4979 | 64.0 | 6816 | 1.0332 | 0.3473 | 0.6454 | 0.3217 | 0.2418 | 0.2874 | 0.5524 | 0.3144 | 0.4862 | 0.5098 | 0.3018 | 0.4781 | 0.7118 | 0.5832 | 0.6856 | 0.3219 | 0.4873 | 0.2925 | 0.4893 | 0.2021 | 0.4169 | 0.3369 | 0.4698 |
| 0.4885 | 64.9953 | 6922 | 1.0259 | 0.3531 | 0.6471 | 0.3464 | 0.247 | 0.2989 | 0.5502 | 0.3127 | 0.4864 | 0.5102 | 0.3106 | 0.4681 | 0.7171 | 0.5859 | 0.6856 | 0.3312 | 0.4835 | 0.295 | 0.4893 | 0.2136 | 0.4215 | 0.3398 | 0.4711 |
| 0.492 | 66.0 | 7029 | 1.0303 | 0.3519 | 0.6474 | 0.3308 | 0.2398 | 0.2948 | 0.5388 | 0.3178 | 0.4903 | 0.5116 | 0.3067 | 0.4698 | 0.7343 | 0.5911 | 0.6865 | 0.3463 | 0.5101 | 0.2885 | 0.4862 | 0.1972 | 0.3985 | 0.3366 | 0.4769 |
| 0.4828 | 66.9953 | 7135 | 1.0223 | 0.3575 | 0.6522 | 0.3399 | 0.2598 | 0.2924 | 0.5403 | 0.3188 | 0.4913 | 0.5143 | 0.3191 | 0.4769 | 0.722 | 0.5863 | 0.6883 | 0.3422 | 0.5063 | 0.2965 | 0.4991 | 0.2155 | 0.3985 | 0.3469 | 0.4791 |
| 0.4767 | 68.0 | 7242 | 1.0212 | 0.3515 | 0.6366 | 0.3428 | 0.2411 | 0.2953 | 0.5386 | 0.3191 | 0.4922 | 0.5187 | 0.3069 | 0.4864 | 0.716 | 0.5963 | 0.6955 | 0.3268 | 0.5139 | 0.2939 | 0.496 | 0.1936 | 0.4 | 0.347 | 0.488 |
| 0.4691 | 68.9953 | 7348 | 1.0297 | 0.3488 | 0.6408 | 0.3322 | 0.2335 | 0.295 | 0.541 | 0.3129 | 0.4871 | 0.5096 | 0.2957 | 0.4691 | 0.7218 | 0.5889 | 0.6869 | 0.3318 | 0.5013 | 0.296 | 0.4821 | 0.1904 | 0.3969 | 0.337 | 0.4809 |
| 0.4643 | 70.0 | 7455 | 1.0563 | 0.3492 | 0.6468 | 0.3263 | 0.2322 | 0.2868 | 0.5228 | 0.3123 | 0.4865 | 0.5107 | 0.293 | 0.4751 | 0.7197 | 0.5836 | 0.6806 | 0.3364 | 0.5152 | 0.2829 | 0.4768 | 0.2131 | 0.4062 | 0.3298 | 0.4747 |
| 0.4682 | 70.9953 | 7561 | 1.0151 | 0.354 | 0.6449 | 0.3353 | 0.243 | 0.2939 | 0.5446 | 0.3149 | 0.4956 | 0.5169 | 0.307 | 0.4767 | 0.7268 | 0.5899 | 0.6991 | 0.3379 | 0.5152 | 0.2997 | 0.4982 | 0.207 | 0.4015 | 0.3353 | 0.4707 |
| 0.4593 | 72.0 | 7668 | 1.0304 | 0.355 | 0.6471 | 0.3297 | 0.2458 | 0.2968 | 0.5427 | 0.3143 | 0.5001 | 0.5221 | 0.3186 | 0.4802 | 0.7327 | 0.5928 | 0.6995 | 0.3388 | 0.5152 | 0.2883 | 0.4933 | 0.2129 | 0.4169 | 0.3422 | 0.4853 |
| 0.4571 | 72.9953 | 7774 | 1.0294 | 0.3542 | 0.6547 | 0.3377 | 0.2586 | 0.3057 | 0.5307 | 0.3111 | 0.4927 | 0.5182 | 0.3255 | 0.4794 | 0.7293 | 0.5922 | 0.6932 | 0.3369 | 0.5076 | 0.2937 | 0.5009 | 0.212 | 0.4077 | 0.3362 | 0.4818 |
| 0.4502 | 74.0 | 7881 | 1.0236 | 0.3516 | 0.6502 | 0.3273 | 0.2426 | 0.2928 | 0.5387 | 0.3144 | 0.4906 | 0.5186 | 0.3158 | 0.4746 | 0.7307 | 0.5894 | 0.686 | 0.3317 | 0.5038 | 0.2922 | 0.4991 | 0.2005 | 0.4154 | 0.3443 | 0.4889 |
| 0.4529 | 74.9953 | 7987 | 1.0256 | 0.3589 | 0.6477 | 0.3379 | 0.2489 | 0.3004 | 0.5406 | 0.321 | 0.4947 | 0.5174 | 0.3113 | 0.4731 | 0.7397 | 0.5964 | 0.6878 | 0.3426 | 0.5165 | 0.2892 | 0.4808 | 0.2237 | 0.4215 | 0.3424 | 0.4804 |
| 0.4326 | 76.0 | 8094 | 1.0340 | 0.3565 | 0.6524 | 0.3318 | 0.2423 | 0.2997 | 0.5421 | 0.3181 | 0.4924 | 0.5186 | 0.3009 | 0.4851 | 0.7374 | 0.5896 | 0.6883 | 0.3456 | 0.5101 | 0.2888 | 0.4951 | 0.2216 | 0.4277 | 0.337 | 0.472 |
| 0.4335 | 76.9953 | 8200 | 1.0309 | 0.353 | 0.6463 | 0.3404 | 0.2424 | 0.2962 | 0.5269 | 0.3146 | 0.4883 | 0.5141 | 0.3117 | 0.4723 | 0.7248 | 0.5909 | 0.6932 | 0.3312 | 0.4949 | 0.2874 | 0.4884 | 0.2102 | 0.4092 | 0.3454 | 0.4849 |
| 0.4301 | 78.0 | 8307 | 1.0323 | 0.3543 | 0.6467 | 0.3249 | 0.2388 | 0.301 | 0.5352 | 0.3157 | 0.4922 | 0.5148 | 0.311 | 0.4839 | 0.7223 | 0.5978 | 0.6959 | 0.3129 | 0.481 | 0.2979 | 0.4924 | 0.2225 | 0.4231 | 0.3402 | 0.4818 |
| 0.4361 | 78.9953 | 8413 | 1.0411 | 0.3506 | 0.6307 | 0.3271 | 0.2316 | 0.2975 | 0.5455 | 0.3145 | 0.4856 | 0.506 | 0.2983 | 0.4767 | 0.7113 | 0.5968 | 0.6923 | 0.3207 | 0.4785 | 0.2885 | 0.4862 | 0.2101 | 0.3985 | 0.3368 | 0.4747 |
| 0.4239 | 80.0 | 8520 | 1.0444 | 0.3533 | 0.6499 | 0.3273 | 0.2517 | 0.2983 | 0.5347 | 0.316 | 0.4898 | 0.5122 | 0.3182 | 0.4807 | 0.7155 | 0.5945 | 0.6914 | 0.3182 | 0.4848 | 0.2874 | 0.4772 | 0.2113 | 0.4246 | 0.3552 | 0.4827 |
| 0.4236 | 80.9953 | 8626 | 1.0340 | 0.3501 | 0.6441 | 0.3328 | 0.252 | 0.2969 | 0.5302 | 0.3175 | 0.4908 | 0.5146 | 0.3185 | 0.4758 | 0.7223 | 0.5976 | 0.6923 | 0.3257 | 0.4886 | 0.2881 | 0.4951 | 0.1922 | 0.4138 | 0.3471 | 0.4831 |
| 0.4219 | 82.0 | 8733 | 1.0312 | 0.3552 | 0.6466 | 0.3365 | 0.2483 | 0.2972 | 0.529 | 0.3249 | 0.4979 | 0.5159 | 0.3333 | 0.4693 | 0.7214 | 0.5936 | 0.686 | 0.3248 | 0.4785 | 0.2958 | 0.4991 | 0.2124 | 0.4292 | 0.3493 | 0.4867 |
| 0.4194 | 82.9953 | 8839 | 1.0364 | 0.3528 | 0.6487 | 0.3394 | 0.2403 | 0.3033 | 0.5353 | 0.3145 | 0.4885 | 0.5107 | 0.3157 | 0.4712 | 0.7137 | 0.5841 | 0.6878 | 0.3305 | 0.4823 | 0.291 | 0.4826 | 0.2092 | 0.4138 | 0.3493 | 0.4871 |
| 0.4163 | 84.0 | 8946 | 1.0441 | 0.3515 | 0.6484 | 0.3379 | 0.2503 | 0.2957 | 0.5294 | 0.3187 | 0.4907 | 0.5126 | 0.3223 | 0.4651 | 0.724 | 0.5906 | 0.6847 | 0.3189 | 0.4949 | 0.2905 | 0.4893 | 0.2171 | 0.4138 | 0.3405 | 0.48 |
| 0.4119 | 84.9953 | 9052 | 1.0541 | 0.3477 | 0.646 | 0.3179 | 0.2355 | 0.2881 | 0.5249 | 0.3167 | 0.4835 | 0.5056 | 0.3035 | 0.4629 | 0.715 | 0.5862 | 0.6806 | 0.3247 | 0.4861 | 0.2886 | 0.4821 | 0.2075 | 0.4123 | 0.3314 | 0.4667 |
| 0.3989 | 86.0 | 9159 | 1.0366 | 0.3525 | 0.651 | 0.3258 | 0.2354 | 0.2998 | 0.5341 | 0.3197 | 0.4873 | 0.5151 | 0.3003 | 0.4835 | 0.7344 | 0.5857 | 0.6865 | 0.3361 | 0.5114 | 0.289 | 0.4826 | 0.2173 | 0.4215 | 0.3343 | 0.4733 |
| 0.4159 | 86.9953 | 9265 | 1.0290 | 0.3569 | 0.6552 | 0.3376 | 0.2391 | 0.3065 | 0.5478 | 0.3184 | 0.4931 | 0.519 | 0.3126 | 0.4859 | 0.7322 | 0.5884 | 0.6869 | 0.333 | 0.5165 | 0.2963 | 0.4897 | 0.217 | 0.42 | 0.3498 | 0.4818 |
| 0.403 | 88.0 | 9372 | 1.0365 | 0.3551 | 0.6506 | 0.3357 | 0.2391 | 0.3 | 0.541 | 0.317 | 0.4926 | 0.5147 | 0.3153 | 0.4828 | 0.725 | 0.5893 | 0.6869 | 0.3369 | 0.4924 | 0.2907 | 0.4929 | 0.2102 | 0.4169 | 0.3482 | 0.4844 |
| 0.3987 | 88.9953 | 9478 | 1.0452 | 0.352 | 0.6489 | 0.3289 | 0.236 | 0.2952 | 0.5296 | 0.3193 | 0.4895 | 0.5119 | 0.3074 | 0.4788 | 0.7254 | 0.585 | 0.6851 | 0.3316 | 0.5 | 0.2928 | 0.4839 | 0.2136 | 0.42 | 0.3367 | 0.4707 |
| 0.3896 | 90.0 | 9585 | 1.0387 | 0.3542 | 0.6505 | 0.332 | 0.2444 | 0.2953 | 0.533 | 0.3175 | 0.4902 | 0.5109 | 0.3242 | 0.4739 | 0.7178 | 0.5897 | 0.6829 | 0.3322 | 0.4861 | 0.2968 | 0.4866 | 0.2106 | 0.4154 | 0.3415 | 0.4836 |
| 0.3962 | 90.9953 | 9691 | 1.0409 | 0.3567 | 0.6523 | 0.3393 | 0.2425 | 0.2994 | 0.536 | 0.3191 | 0.4865 | 0.5115 | 0.3111 | 0.4759 | 0.7197 | 0.5938 | 0.6878 | 0.3344 | 0.4873 | 0.2996 | 0.4875 | 0.2196 | 0.4169 | 0.3363 | 0.4778 |
| 0.3908 | 92.0 | 9798 | 1.0450 | 0.3525 | 0.6514 | 0.3288 | 0.2381 | 0.2953 | 0.5385 | 0.3191 | 0.4881 | 0.5127 | 0.3094 | 0.4801 | 0.7231 | 0.5938 | 0.6905 | 0.3248 | 0.4924 | 0.2932 | 0.4866 | 0.2136 | 0.42 | 0.3372 | 0.4738 |
| 0.3887 | 92.9953 | 9904 | 1.0431 | 0.3549 | 0.657 | 0.3277 | 0.246 | 0.2949 | 0.5399 | 0.3189 | 0.489 | 0.5167 | 0.3195 | 0.4807 | 0.7278 | 0.5909 | 0.691 | 0.3313 | 0.4937 | 0.2924 | 0.4848 | 0.2184 | 0.4354 | 0.3415 | 0.4787 |
| 0.3818 | 94.0 | 10011 | 1.0451 | 0.3524 | 0.6528 | 0.3303 | 0.246 | 0.2896 | 0.5338 | 0.3166 | 0.4872 | 0.5149 | 0.3134 | 0.4802 | 0.7217 | 0.5889 | 0.6883 | 0.3264 | 0.4911 | 0.2931 | 0.4871 | 0.2114 | 0.4292 | 0.3421 | 0.4787 |
| 0.3886 | 94.9953 | 10117 | 1.0395 | 0.3561 | 0.6557 | 0.3254 | 0.2546 | 0.2965 | 0.5352 | 0.3202 | 0.4903 | 0.5139 | 0.3246 | 0.4775 | 0.7178 | 0.5897 | 0.6919 | 0.3325 | 0.4962 | 0.2999 | 0.4857 | 0.2147 | 0.4154 | 0.3435 | 0.4804 |
| 0.3816 | 96.0 | 10224 | 1.0435 | 0.3538 | 0.6543 | 0.3315 | 0.2416 | 0.2948 | 0.5357 | 0.3161 | 0.4872 | 0.5134 | 0.3031 | 0.4808 | 0.7266 | 0.5911 | 0.6896 | 0.3292 | 0.4937 | 0.2954 | 0.4799 | 0.2121 | 0.4292 | 0.3412 | 0.4747 |
| 0.382 | 96.9953 | 10330 | 1.0447 | 0.3528 | 0.6521 | 0.3291 | 0.2406 | 0.2951 | 0.5347 | 0.3178 | 0.4882 | 0.5132 | 0.3062 | 0.4824 | 0.7205 | 0.5894 | 0.6847 | 0.3252 | 0.4937 | 0.2956 | 0.4839 | 0.2089 | 0.4262 | 0.3447 | 0.4778 |
| 0.3812 | 98.0 | 10437 | 1.0450 | 0.3516 | 0.6501 | 0.3338 | 0.2428 | 0.2936 | 0.5323 | 0.3164 | 0.486 | 0.509 | 0.3119 | 0.4683 | 0.7168 | 0.5872 | 0.6847 | 0.3235 | 0.4861 | 0.2937 | 0.4839 | 0.2077 | 0.4123 | 0.346 | 0.4778 |
| 0.3781 | 98.9953 | 10543 | 1.0455 | 0.3511 | 0.6497 | 0.3269 | 0.2413 | 0.2912 | 0.5313 | 0.3163 | 0.4852 | 0.5093 | 0.3088 | 0.4716 | 0.7137 | 0.5876 | 0.6847 | 0.328 | 0.4886 | 0.2891 | 0.4817 | 0.2066 | 0.4169 | 0.3442 | 0.4747 |
| 0.3539 | 99.5305 | 10600 | 1.0442 | 0.3514 | 0.6496 | 0.3279 | 0.2421 | 0.2912 | 0.5328 | 0.3162 | 0.4852 | 0.5091 | 0.3118 | 0.4684 | 0.7154 | 0.5877 | 0.6851 | 0.3269 | 0.4873 | 0.2902 | 0.4821 | 0.2064 | 0.4138 | 0.3456 | 0.4769 |
### Framework versions
- Transformers 4.41.0.dev0
- Pytorch 1.13.0+cu117
- Datasets 2.18.0
- Tokenizers 0.19.0
|