|
---
|
|
base_model: microsoft/conditional-detr-resnet-50
|
|
license: apache-2.0
|
|
tags:
|
|
- generated_from_trainer
|
|
model-index:
|
|
- name: vehicle_detection
|
|
results: []
|
|
---
|
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
should probably proofread and complete it, then remove this comment. -->
|
|
|
|
# vehicle_detection
|
|
|
|
This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the None dataset.
|
|
It achieves the following results on the evaluation set:
|
|
- Loss: 0.2233
|
|
- Map: 0.9186
|
|
- Map 50: 0.9888
|
|
- Map 75: 0.9702
|
|
- Map Small: 0.0168
|
|
- Map Medium: 0.8326
|
|
- Map Large: 0.9267
|
|
- Mar 1: 0.39
|
|
- Mar 10: 0.9118
|
|
- Mar 100: 0.9461
|
|
- Mar Small: 0.0167
|
|
- Mar Medium: 0.883
|
|
- Mar Large: 0.953
|
|
- Map Car: 0.9208
|
|
- Mar 100 Car: 0.9447
|
|
- Map Twowheeler: 0.9227
|
|
- Mar 100 Twowheeler: 0.9476
|
|
- Map Auto: 0.8797
|
|
- Mar 100 Auto: 0.9232
|
|
- Map Bus: 0.93
|
|
- Mar 100 Bus: 0.9552
|
|
- Map Truck: 0.94
|
|
- Mar 100 Truck: 0.9599
|
|
|
|
## Model description
|
|
|
|
More information needed
|
|
|
|
## Intended uses & limitations
|
|
|
|
More information needed
|
|
|
|
## Training and evaluation data
|
|
|
|
More information needed
|
|
|
|
## Training procedure
|
|
|
|
### Training hyperparameters
|
|
|
|
The following hyperparameters were used during training:
|
|
- learning_rate: 5e-05
|
|
- train_batch_size: 4
|
|
- eval_batch_size: 8
|
|
- seed: 42
|
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
|
- lr_scheduler_type: cosine
|
|
- num_epochs: 100
|
|
- mixed_precision_training: Native AMP
|
|
|
|
### Training results
|
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Car | Mar 100 Car | Map Twowheeler | Mar 100 Twowheeler | Map Auto | Mar 100 Auto | Map Bus | Mar 100 Bus | Map Truck | Mar 100 Truck |
|
|
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:-------:|:-----------:|:--------------:|:------------------:|:--------:|:------------:|:-------:|:-----------:|:---------:|:-------------:|
|
|
| No log | 1.0 | 229 | 1.9856 | 0.0192 | 0.0426 | 0.0169 | 0.0 | 0.0005 | 0.0205 | 0.0089 | 0.0398 | 0.106 | 0.0 | 0.0074 | 0.1124 | 0.0947 | 0.5102 | 0.0015 | 0.02 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
|
|
| No log | 2.0 | 458 | 1.6568 | 0.0551 | 0.1059 | 0.0545 | 0.0 | 0.0483 | 0.056 | 0.0427 | 0.1326 | 0.2109 | 0.0 | 0.1499 | 0.2097 | 0.1798 | 0.6435 | 0.0178 | 0.1473 | 0.0686 | 0.1522 | 0.0007 | 0.0325 | 0.0088 | 0.0787 |
|
|
| 3.2288 | 3.0 | 687 | 1.5186 | 0.1102 | 0.1976 | 0.1134 | 0.0 | 0.0914 | 0.1095 | 0.0734 | 0.238 | 0.3274 | 0.0 | 0.1826 | 0.3338 | 0.2763 | 0.6943 | 0.1158 | 0.4139 | 0.1317 | 0.271 | 0.0226 | 0.119 | 0.0046 | 0.1386 |
|
|
| 3.2288 | 4.0 | 916 | 1.3361 | 0.1499 | 0.2474 | 0.1617 | 0.0 | 0.1175 | 0.1508 | 0.0948 | 0.3171 | 0.4177 | 0.0 | 0.2566 | 0.4266 | 0.3726 | 0.7412 | 0.1597 | 0.579 | 0.1768 | 0.3913 | 0.0275 | 0.1867 | 0.0129 | 0.1906 |
|
|
| 1.4282 | 5.0 | 1145 | 1.2549 | 0.1958 | 0.326 | 0.2123 | 0.0 | 0.1189 | 0.2027 | 0.1253 | 0.4038 | 0.5086 | 0.0 | 0.2705 | 0.5279 | 0.4481 | 0.7446 | 0.2302 | 0.6364 | 0.1981 | 0.4741 | 0.0537 | 0.3586 | 0.0488 | 0.3292 |
|
|
| 1.4282 | 6.0 | 1374 | 1.1393 | 0.2589 | 0.398 | 0.2816 | 0.0 | 0.2273 | 0.2586 | 0.1605 | 0.5096 | 0.6228 | 0.0 | 0.4519 | 0.6371 | 0.5211 | 0.7628 | 0.3211 | 0.7083 | 0.2883 | 0.6504 | 0.0848 | 0.4807 | 0.0793 | 0.5119 |
|
|
| 1.172 | 7.0 | 1603 | 1.0888 | 0.3236 | 0.4901 | 0.3573 | 0.0 | 0.3587 | 0.3187 | 0.1885 | 0.5581 | 0.6591 | 0.0 | 0.5986 | 0.6641 | 0.5699 | 0.7709 | 0.393 | 0.7138 | 0.3439 | 0.661 | 0.1689 | 0.5467 | 0.1424 | 0.6031 |
|
|
| 1.172 | 8.0 | 1832 | 0.9997 | 0.3794 | 0.5421 | 0.4216 | 0.0 | 0.3792 | 0.3785 | 0.2154 | 0.6143 | 0.7034 | 0.0 | 0.6357 | 0.7102 | 0.6207 | 0.7971 | 0.47 | 0.7611 | 0.4082 | 0.6813 | 0.2144 | 0.6463 | 0.1835 | 0.6314 |
|
|
| 1.0361 | 9.0 | 2061 | 0.9796 | 0.424 | 0.6006 | 0.4761 | 0.0114 | 0.3865 | 0.43 | 0.2416 | 0.6314 | 0.717 | 0.0333 | 0.5976 | 0.7297 | 0.6461 | 0.7925 | 0.5229 | 0.7637 | 0.3866 | 0.6755 | 0.2786 | 0.6679 | 0.2857 | 0.6855 |
|
|
| 1.0361 | 10.0 | 2290 | 0.8782 | 0.5167 | 0.6937 | 0.5831 | 0.0 | 0.4704 | 0.524 | 0.2729 | 0.6941 | 0.7711 | 0.0 | 0.6556 | 0.7819 | 0.6851 | 0.8177 | 0.5872 | 0.7896 | 0.4967 | 0.7474 | 0.374 | 0.6988 | 0.4407 | 0.8018 |
|
|
| 0.9095 | 11.0 | 2519 | 0.8567 | 0.5329 | 0.7133 | 0.6079 | 0.0 | 0.4845 | 0.5393 | 0.2805 | 0.6993 | 0.773 | 0.0 | 0.6472 | 0.7856 | 0.6822 | 0.8049 | 0.599 | 0.7895 | 0.5309 | 0.7533 | 0.3702 | 0.7294 | 0.4825 | 0.7877 |
|
|
| 0.9095 | 12.0 | 2748 | 0.8288 | 0.5647 | 0.7448 | 0.6448 | 0.1347 | 0.489 | 0.5734 | 0.2862 | 0.7164 | 0.7853 | 0.1333 | 0.6483 | 0.7975 | 0.6904 | 0.8157 | 0.6037 | 0.7808 | 0.5581 | 0.7641 | 0.4403 | 0.7539 | 0.5308 | 0.8118 |
|
|
| 0.9095 | 13.0 | 2977 | 0.7847 | 0.5902 | 0.7746 | 0.674 | 0.0 | 0.5372 | 0.5951 | 0.2964 | 0.7264 | 0.7867 | 0.0 | 0.6727 | 0.7978 | 0.7096 | 0.8184 | 0.6454 | 0.8043 | 0.5636 | 0.7631 | 0.4959 | 0.7512 | 0.5364 | 0.7963 |
|
|
| 0.8129 | 14.0 | 3206 | 0.7430 | 0.6291 | 0.8117 | 0.7151 | 0.0 | 0.5248 | 0.6378 | 0.3103 | 0.7454 | 0.801 | 0.0 | 0.6606 | 0.8146 | 0.7295 | 0.8314 | 0.6656 | 0.8225 | 0.6015 | 0.7824 | 0.5479 | 0.7588 | 0.6009 | 0.81 |
|
|
| 0.8129 | 15.0 | 3435 | 0.7187 | 0.6398 | 0.8242 | 0.737 | 0.0 | 0.5326 | 0.6482 | 0.3083 | 0.7487 | 0.8027 | 0.0 | 0.672 | 0.8135 | 0.7392 | 0.8356 | 0.6817 | 0.8242 | 0.6307 | 0.7929 | 0.5222 | 0.7398 | 0.6251 | 0.821 |
|
|
| 0.748 | 16.0 | 3664 | 0.7008 | 0.6486 | 0.83 | 0.735 | 0.0 | 0.5434 | 0.6576 | 0.3076 | 0.7524 | 0.8049 | 0.0 | 0.6797 | 0.8164 | 0.7529 | 0.844 | 0.6859 | 0.8224 | 0.6329 | 0.7932 | 0.5457 | 0.7446 | 0.6255 | 0.8203 |
|
|
| 0.748 | 17.0 | 3893 | 0.7042 | 0.6523 | 0.8462 | 0.7542 | 0.0 | 0.5646 | 0.6612 | 0.3162 | 0.7525 | 0.806 | 0.0 | 0.679 | 0.8181 | 0.7367 | 0.826 | 0.6755 | 0.804 | 0.6157 | 0.7821 | 0.5825 | 0.788 | 0.651 | 0.83 |
|
|
| 0.6979 | 18.0 | 4122 | 0.6434 | 0.6987 | 0.8684 | 0.7936 | 0.0 | 0.5947 | 0.7073 | 0.3282 | 0.7857 | 0.8348 | 0.0 | 0.7175 | 0.8469 | 0.7767 | 0.8561 | 0.7213 | 0.8463 | 0.6801 | 0.8165 | 0.643 | 0.8022 | 0.6722 | 0.8529 |
|
|
| 0.6979 | 19.0 | 4351 | 0.6231 | 0.7049 | 0.8806 | 0.8131 | 0.0 | 0.607 | 0.7131 | 0.3297 | 0.7819 | 0.827 | 0.0 | 0.7175 | 0.8374 | 0.761 | 0.8424 | 0.7167 | 0.8383 | 0.7004 | 0.82 | 0.6527 | 0.7882 | 0.6936 | 0.8461 |
|
|
| 0.6589 | 20.0 | 4580 | 0.6284 | 0.7074 | 0.8836 | 0.8081 | 0.0 | 0.6173 | 0.7146 | 0.3324 | 0.785 | 0.8311 | 0.0 | 0.7258 | 0.8409 | 0.7747 | 0.8543 | 0.7168 | 0.8345 | 0.6881 | 0.8136 | 0.6575 | 0.8058 | 0.6997 | 0.8474 |
|
|
| 0.6589 | 21.0 | 4809 | 0.5998 | 0.7205 | 0.8955 | 0.8187 | 0.0 | 0.6133 | 0.7302 | 0.3325 | 0.7944 | 0.8427 | 0.0 | 0.7266 | 0.8543 | 0.7821 | 0.8565 | 0.7414 | 0.8484 | 0.6888 | 0.8175 | 0.6778 | 0.83 | 0.7125 | 0.861 |
|
|
| 0.6182 | 22.0 | 5038 | 0.6040 | 0.7196 | 0.888 | 0.8178 | 0.0 | 0.6161 | 0.7304 | 0.3288 | 0.7937 | 0.8427 | 0.0 | 0.7385 | 0.8538 | 0.7863 | 0.8609 | 0.745 | 0.8573 | 0.6975 | 0.8247 | 0.6467 | 0.8147 | 0.7227 | 0.8561 |
|
|
| 0.6182 | 23.0 | 5267 | 0.5959 | 0.7329 | 0.8994 | 0.8317 | 0.0 | 0.6189 | 0.7412 | 0.338 | 0.8018 | 0.8459 | 0.0 | 0.7299 | 0.8566 | 0.7921 | 0.864 | 0.7467 | 0.8585 | 0.7291 | 0.8403 | 0.6852 | 0.8164 | 0.7114 | 0.8506 |
|
|
| 0.6182 | 24.0 | 5496 | 0.5712 | 0.7374 | 0.9106 | 0.8392 | 0.0038 | 0.649 | 0.744 | 0.3395 | 0.802 | 0.8487 | 0.0583 | 0.7426 | 0.8587 | 0.7918 | 0.8633 | 0.7476 | 0.8527 | 0.7115 | 0.8233 | 0.6865 | 0.8282 | 0.7499 | 0.8761 |
|
|
| 0.6034 | 25.0 | 5725 | 0.5547 | 0.7488 | 0.9191 | 0.8456 | 0.0 | 0.6335 | 0.7602 | 0.3434 | 0.8077 | 0.8548 | 0.0 | 0.7327 | 0.8675 | 0.804 | 0.8697 | 0.7675 | 0.8616 | 0.7157 | 0.8413 | 0.722 | 0.847 | 0.7349 | 0.8542 |
|
|
| 0.6034 | 26.0 | 5954 | 0.5622 | 0.7466 | 0.9177 | 0.8593 | 0.0 | 0.62 | 0.7598 | 0.3441 | 0.8036 | 0.8473 | 0.0 | 0.7238 | 0.8588 | 0.7931 | 0.8637 | 0.749 | 0.8513 | 0.7233 | 0.8337 | 0.7156 | 0.822 | 0.7522 | 0.8657 |
|
|
| 0.5794 | 27.0 | 6183 | 0.5197 | 0.7662 | 0.9283 | 0.8704 | 0.0 | 0.6591 | 0.7743 | 0.3468 | 0.8152 | 0.8566 | 0.0 | 0.7497 | 0.8669 | 0.8087 | 0.8741 | 0.7721 | 0.8659 | 0.7519 | 0.8431 | 0.7331 | 0.8313 | 0.7652 | 0.8685 |
|
|
| 0.5794 | 28.0 | 6412 | 0.5260 | 0.7729 | 0.9325 | 0.8779 | 0.0 | 0.6734 | 0.7813 | 0.345 | 0.8214 | 0.866 | 0.0 | 0.7614 | 0.8768 | 0.8157 | 0.8773 | 0.773 | 0.8663 | 0.7612 | 0.8542 | 0.7359 | 0.8431 | 0.7787 | 0.889 |
|
|
| 0.5511 | 29.0 | 6641 | 0.5145 | 0.7624 | 0.9301 | 0.8628 | 0.0 | 0.6492 | 0.7709 | 0.3447 | 0.8096 | 0.8564 | 0.0 | 0.7421 | 0.8666 | 0.814 | 0.8736 | 0.7687 | 0.8607 | 0.7453 | 0.8426 | 0.725 | 0.8448 | 0.7592 | 0.8604 |
|
|
| 0.5511 | 30.0 | 6870 | 0.4996 | 0.7762 | 0.9407 | 0.8836 | 0.0257 | 0.6791 | 0.7816 | 0.3488 | 0.8238 | 0.8656 | 0.025 | 0.7691 | 0.8748 | 0.8188 | 0.8773 | 0.7721 | 0.8684 | 0.7494 | 0.8428 | 0.7624 | 0.8633 | 0.7785 | 0.8761 |
|
|
| 0.5377 | 31.0 | 7099 | 0.4853 | 0.7911 | 0.946 | 0.9015 | 0.0 | 0.6981 | 0.7972 | 0.3546 | 0.8273 | 0.8692 | 0.0 | 0.7815 | 0.8762 | 0.8236 | 0.8826 | 0.8004 | 0.8762 | 0.7789 | 0.8565 | 0.765 | 0.8597 | 0.7875 | 0.8709 |
|
|
| 0.5377 | 32.0 | 7328 | 0.4858 | 0.7869 | 0.941 | 0.8932 | 0.0 | 0.679 | 0.7969 | 0.3508 | 0.8262 | 0.8699 | 0.0 | 0.7711 | 0.8803 | 0.8251 | 0.8822 | 0.7992 | 0.8823 | 0.7576 | 0.8489 | 0.7519 | 0.8444 | 0.8006 | 0.8919 |
|
|
| 0.5134 | 33.0 | 7557 | 0.4781 | 0.7857 | 0.944 | 0.9 | 0.0 | 0.6941 | 0.794 | 0.3543 | 0.8231 | 0.8641 | 0.0 | 0.7822 | 0.8715 | 0.8221 | 0.8807 | 0.8036 | 0.8794 | 0.7642 | 0.8548 | 0.7576 | 0.8364 | 0.781 | 0.8691 |
|
|
| 0.5134 | 34.0 | 7786 | 0.4783 | 0.7923 | 0.9472 | 0.8978 | 0.0 | 0.677 | 0.8006 | 0.3537 | 0.8316 | 0.8722 | 0.0 | 0.7665 | 0.8818 | 0.8281 | 0.8854 | 0.8027 | 0.8829 | 0.7795 | 0.8617 | 0.7501 | 0.8466 | 0.8014 | 0.8842 |
|
|
| 0.5006 | 35.0 | 8015 | 0.4689 | 0.7943 | 0.9499 | 0.9028 | 0.0101 | 0.6986 | 0.8017 | 0.3551 | 0.8301 | 0.8698 | 0.05 | 0.7826 | 0.8783 | 0.8285 | 0.8846 | 0.8059 | 0.8816 | 0.7777 | 0.8613 | 0.7632 | 0.8477 | 0.7961 | 0.8735 |
|
|
| 0.5006 | 36.0 | 8244 | 0.4788 | 0.794 | 0.9477 | 0.9019 | 0.0 | 0.708 | 0.8004 | 0.3539 | 0.8292 | 0.8694 | 0.0 | 0.7749 | 0.8778 | 0.827 | 0.8839 | 0.8069 | 0.8811 | 0.7793 | 0.8541 | 0.7679 | 0.8477 | 0.7888 | 0.8803 |
|
|
| 0.5006 | 37.0 | 8473 | 0.4364 | 0.8171 | 0.9586 | 0.9214 | 0.0 | 0.7011 | 0.8249 | 0.3635 | 0.8448 | 0.8844 | 0.0 | 0.7808 | 0.8935 | 0.8447 | 0.8936 | 0.8148 | 0.8844 | 0.7914 | 0.8687 | 0.8181 | 0.8918 | 0.8164 | 0.8834 |
|
|
| 0.4862 | 38.0 | 8702 | 0.4287 | 0.8104 | 0.9598 | 0.9135 | 0.0 | 0.7261 | 0.8158 | 0.3582 | 0.8422 | 0.8806 | 0.0 | 0.8008 | 0.8879 | 0.843 | 0.8947 | 0.8215 | 0.8913 | 0.8011 | 0.8721 | 0.7848 | 0.8672 | 0.8015 | 0.8776 |
|
|
| 0.4862 | 39.0 | 8931 | 0.4381 | 0.8088 | 0.9565 | 0.9112 | 0.0 | 0.7092 | 0.8165 | 0.3586 | 0.8421 | 0.8833 | 0.0 | 0.7832 | 0.8931 | 0.842 | 0.8954 | 0.8195 | 0.8916 | 0.7791 | 0.8664 | 0.7898 | 0.8706 | 0.8134 | 0.8926 |
|
|
| 0.467 | 40.0 | 9160 | 0.4064 | 0.8247 | 0.9641 | 0.9272 | 0.0 | 0.7091 | 0.8334 | 0.3659 | 0.8506 | 0.8873 | 0.0 | 0.7813 | 0.8972 | 0.8478 | 0.8972 | 0.8326 | 0.8964 | 0.7952 | 0.8716 | 0.8167 | 0.8814 | 0.8313 | 0.8901 |
|
|
| 0.467 | 41.0 | 9389 | 0.4180 | 0.8301 | 0.9634 | 0.926 | 0.0284 | 0.7306 | 0.8379 | 0.3643 | 0.8528 | 0.8907 | 0.05 | 0.8049 | 0.8986 | 0.856 | 0.8991 | 0.8307 | 0.8949 | 0.812 | 0.8768 | 0.8181 | 0.8843 | 0.8336 | 0.8982 |
|
|
| 0.4425 | 42.0 | 9618 | 0.4123 | 0.8297 | 0.9644 | 0.9247 | 0.0 | 0.7309 | 0.8382 | 0.3647 | 0.8541 | 0.8903 | 0.0 | 0.8033 | 0.8985 | 0.8575 | 0.9011 | 0.8411 | 0.9026 | 0.8103 | 0.8795 | 0.8069 | 0.8672 | 0.8325 | 0.9011 |
|
|
| 0.4425 | 43.0 | 9847 | 0.3825 | 0.8389 | 0.9691 | 0.9398 | 0.0 | 0.7355 | 0.8473 | 0.3697 | 0.8586 | 0.8978 | 0.0 | 0.806 | 0.9065 | 0.8608 | 0.9044 | 0.8405 | 0.9065 | 0.8139 | 0.8834 | 0.8374 | 0.8913 | 0.8417 | 0.9033 |
|
|
| 0.4263 | 44.0 | 10076 | 0.3773 | 0.8377 | 0.9684 | 0.931 | 0.0 | 0.7218 | 0.8459 | 0.3644 | 0.856 | 0.8949 | 0.0 | 0.7984 | 0.9029 | 0.8612 | 0.9027 | 0.8361 | 0.8981 | 0.822 | 0.884 | 0.8272 | 0.8877 | 0.8418 | 0.9018 |
|
|
| 0.4263 | 45.0 | 10305 | 0.3904 | 0.824 | 0.9688 | 0.9284 | 0.0084 | 0.7317 | 0.8306 | 0.3598 | 0.8491 | 0.8863 | 0.0167 | 0.8004 | 0.894 | 0.8516 | 0.895 | 0.8268 | 0.8931 | 0.8067 | 0.8747 | 0.817 | 0.8841 | 0.8182 | 0.8847 |
|
|
| 0.4204 | 46.0 | 10534 | 0.3656 | 0.8462 | 0.974 | 0.9396 | 0.0 | 0.7568 | 0.8524 | 0.3682 | 0.8649 | 0.9007 | 0.0 | 0.8266 | 0.9073 | 0.8657 | 0.9099 | 0.8506 | 0.9074 | 0.8161 | 0.8809 | 0.8292 | 0.8877 | 0.8694 | 0.9175 |
|
|
| 0.4204 | 47.0 | 10763 | 0.3758 | 0.8349 | 0.9718 | 0.9392 | 0.0 | 0.7035 | 0.8459 | 0.368 | 0.855 | 0.8913 | 0.0 | 0.7802 | 0.9019 | 0.8541 | 0.8991 | 0.8451 | 0.8987 | 0.8029 | 0.8726 | 0.8283 | 0.886 | 0.8443 | 0.9 |
|
|
| 0.4204 | 48.0 | 10992 | 0.3809 | 0.8353 | 0.9678 | 0.9295 | 0.0118 | 0.7351 | 0.8425 | 0.3663 | 0.857 | 0.893 | 0.05 | 0.8026 | 0.9015 | 0.8607 | 0.9038 | 0.8356 | 0.8969 | 0.7936 | 0.8686 | 0.8459 | 0.8983 | 0.8406 | 0.8972 |
|
|
| 0.3935 | 49.0 | 11221 | 0.3698 | 0.8474 | 0.9735 | 0.9409 | -1.0 | 0.7592 | 0.8521 | 0.3697 | 0.8651 | 0.9015 | -1.0 | 0.8194 | 0.9087 | 0.8689 | 0.9079 | 0.858 | 0.9095 | 0.8152 | 0.8836 | 0.8403 | 0.8993 | 0.8546 | 0.9072 |
|
|
| 0.3935 | 50.0 | 11450 | 0.3514 | 0.8575 | 0.9736 | 0.9426 | -1.0 | 0.7425 | 0.8654 | 0.374 | 0.8699 | 0.9073 | -1.0 | 0.8195 | 0.9155 | 0.8727 | 0.911 | 0.8644 | 0.9151 | 0.8218 | 0.8843 | 0.8571 | 0.9039 | 0.8714 | 0.9225 |
|
|
| 0.3968 | 51.0 | 11679 | 0.3494 | 0.8593 | 0.9771 | 0.9505 | 0.0 | 0.7601 | 0.8679 | 0.3719 | 0.8711 | 0.9076 | 0.0 | 0.8205 | 0.9161 | 0.8777 | 0.914 | 0.861 | 0.9132 | 0.8315 | 0.8882 | 0.8538 | 0.9022 | 0.8727 | 0.9202 |
|
|
| 0.3968 | 52.0 | 11908 | 0.3445 | 0.8562 | 0.9765 | 0.9461 | 0.0 | 0.7603 | 0.8639 | 0.3721 | 0.8684 | 0.9052 | 0.0 | 0.8178 | 0.9136 | 0.8709 | 0.9081 | 0.8565 | 0.9057 | 0.8201 | 0.8807 | 0.8635 | 0.9106 | 0.8698 | 0.921 |
|
|
| 0.3821 | 53.0 | 12137 | 0.3250 | 0.8633 | 0.9803 | 0.9565 | 0.0 | 0.7553 | 0.873 | 0.3764 | 0.8752 | 0.9117 | 0.0 | 0.8214 | 0.9208 | 0.8715 | 0.9119 | 0.8656 | 0.9148 | 0.8328 | 0.893 | 0.8728 | 0.9166 | 0.8738 | 0.9221 |
|
|
| 0.3821 | 54.0 | 12366 | 0.3107 | 0.875 | 0.9819 | 0.9631 | 0.5 | 0.775 | 0.8823 | 0.3779 | 0.8859 | 0.9192 | 0.5 | 0.8342 | 0.9269 | 0.884 | 0.9199 | 0.8872 | 0.9289 | 0.8457 | 0.8988 | 0.8765 | 0.9205 | 0.8814 | 0.9279 |
|
|
| 0.3697 | 55.0 | 12595 | 0.3092 | 0.8724 | 0.9804 | 0.9569 | 0.0125 | 0.7686 | 0.8796 | 0.3769 | 0.8803 | 0.9152 | 0.05 | 0.8259 | 0.923 | 0.8804 | 0.9167 | 0.8782 | 0.9198 | 0.8347 | 0.8895 | 0.8778 | 0.9195 | 0.8907 | 0.9305 |
|
|
| 0.3697 | 56.0 | 12824 | 0.3221 | 0.865 | 0.9815 | 0.9558 | 0.0 | 0.7603 | 0.8733 | 0.3748 | 0.8764 | 0.9117 | 0.0 | 0.8283 | 0.9199 | 0.8776 | 0.9166 | 0.8651 | 0.9133 | 0.8387 | 0.8942 | 0.8605 | 0.9114 | 0.883 | 0.923 |
|
|
| 0.3658 | 57.0 | 13053 | 0.3189 | 0.8614 | 0.9765 | 0.952 | 0.0 | 0.744 | 0.8687 | 0.3718 | 0.8728 | 0.9055 | 0.0 | 0.7956 | 0.9155 | 0.883 | 0.9187 | 0.8745 | 0.9148 | 0.8342 | 0.8899 | 0.8478 | 0.8961 | 0.8672 | 0.9077 |
|
|
| 0.3658 | 58.0 | 13282 | 0.3202 | 0.8636 | 0.9787 | 0.9492 | 0.0167 | 0.7338 | 0.8732 | 0.3733 | 0.8727 | 0.9082 | 0.0333 | 0.8006 | 0.918 | 0.8787 | 0.9145 | 0.8703 | 0.9139 | 0.8363 | 0.8902 | 0.8577 | 0.9053 | 0.8747 | 0.9173 |
|
|
| 0.3469 | 59.0 | 13511 | 0.3084 | 0.8795 | 0.9815 | 0.957 | 0.0 | 0.7775 | 0.8865 | 0.3786 | 0.8846 | 0.9188 | 0.0 | 0.8365 | 0.9258 | 0.8897 | 0.9219 | 0.8825 | 0.9237 | 0.8477 | 0.8984 | 0.8844 | 0.9217 | 0.8933 | 0.928 |
|
|
| 0.3469 | 60.0 | 13740 | 0.3030 | 0.8802 | 0.982 | 0.9588 | 0.0269 | 0.7834 | 0.8881 | 0.3799 | 0.8839 | 0.9186 | 0.1333 | 0.8397 | 0.926 | 0.893 | 0.9249 | 0.8857 | 0.9241 | 0.8494 | 0.9001 | 0.8859 | 0.9195 | 0.8869 | 0.9243 |
|
|
| 0.3469 | 61.0 | 13969 | 0.3030 | 0.8778 | 0.983 | 0.964 | 0.0071 | 0.7856 | 0.8853 | 0.3808 | 0.8833 | 0.9177 | 0.05 | 0.8419 | 0.9246 | 0.884 | 0.9182 | 0.8816 | 0.9221 | 0.8455 | 0.8948 | 0.8868 | 0.9239 | 0.891 | 0.9298 |
|
|
| 0.3303 | 62.0 | 14198 | 0.3037 | 0.8785 | 0.9819 | 0.9582 | 0.0024 | 0.7757 | 0.8866 | 0.3783 | 0.8847 | 0.919 | 0.0333 | 0.8334 | 0.9269 | 0.8897 | 0.9227 | 0.8862 | 0.9257 | 0.8444 | 0.8991 | 0.8717 | 0.913 | 0.9007 | 0.9344 |
|
|
| 0.3303 | 63.0 | 14427 | 0.2819 | 0.8859 | 0.9829 | 0.9624 | 0.0 | 0.7911 | 0.8923 | 0.3813 | 0.8888 | 0.9229 | 0.0 | 0.847 | 0.9297 | 0.8949 | 0.925 | 0.8976 | 0.9325 | 0.8558 | 0.9084 | 0.8822 | 0.9164 | 0.8988 | 0.932 |
|
|
| 0.3278 | 64.0 | 14656 | 0.2771 | 0.8886 | 0.9878 | 0.9668 | 0.0 | 0.8116 | 0.8935 | 0.3804 | 0.8916 | 0.9256 | 0.0 | 0.8659 | 0.9311 | 0.8912 | 0.9234 | 0.8903 | 0.9275 | 0.8564 | 0.9065 | 0.8982 | 0.9316 | 0.9071 | 0.9388 |
|
|
| 0.3278 | 65.0 | 14885 | 0.2647 | 0.8869 | 0.9805 | 0.961 | 0.0 | 0.7776 | 0.8956 | 0.3814 | 0.8904 | 0.9236 | 0.0 | 0.8299 | 0.9323 | 0.8997 | 0.9306 | 0.9027 | 0.9357 | 0.8565 | 0.9077 | 0.8827 | 0.92 | 0.8928 | 0.9242 |
|
|
| 0.3251 | 66.0 | 15114 | 0.2738 | 0.8856 | 0.9815 | 0.9598 | 0.0 | 0.8047 | 0.893 | 0.3808 | 0.8898 | 0.9219 | 0.0 | 0.8593 | 0.9286 | 0.9009 | 0.9303 | 0.8936 | 0.9269 | 0.8504 | 0.9014 | 0.8972 | 0.9314 | 0.8858 | 0.9193 |
|
|
| 0.3251 | 67.0 | 15343 | 0.2822 | 0.892 | 0.9846 | 0.9658 | 0.0126 | 0.8003 | 0.9007 | 0.3816 | 0.8941 | 0.9282 | 0.0125 | 0.8611 | 0.9352 | 0.8977 | 0.9294 | 0.8929 | 0.9286 | 0.8681 | 0.915 | 0.8899 | 0.9265 | 0.9112 | 0.9417 |
|
|
| 0.3013 | 68.0 | 15572 | 0.2507 | 0.8976 | 0.9867 | 0.9696 | 0.0 | 0.8044 | 0.9054 | 0.3832 | 0.8975 | 0.9315 | 0.0 | 0.857 | 0.939 | 0.9076 | 0.9355 | 0.9059 | 0.9371 | 0.8672 | 0.9138 | 0.8885 | 0.9224 | 0.9187 | 0.9487 |
|
|
| 0.3013 | 69.0 | 15801 | 0.2612 | 0.893 | 0.9817 | 0.9624 | 0.0 | 0.7973 | 0.9006 | 0.3835 | 0.8937 | 0.9269 | 0.0 | 0.8556 | 0.934 | 0.9004 | 0.9302 | 0.9028 | 0.9359 | 0.8654 | 0.9148 | 0.9026 | 0.934 | 0.8935 | 0.9199 |
|
|
| 0.304 | 70.0 | 16030 | 0.2574 | 0.8952 | 0.9861 | 0.9674 | 0.0 | 0.8081 | 0.9022 | 0.3818 | 0.8942 | 0.9291 | 0.0 | 0.8607 | 0.9359 | 0.9026 | 0.9315 | 0.9017 | 0.9339 | 0.8629 | 0.91 | 0.8928 | 0.9267 | 0.9159 | 0.9432 |
|
|
| 0.304 | 71.0 | 16259 | 0.2560 | 0.9046 | 0.9867 | 0.9742 | 0.0 | 0.8298 | 0.9113 | 0.3859 | 0.9039 | 0.9375 | 0.0 | 0.8826 | 0.943 | 0.9075 | 0.9358 | 0.9111 | 0.9415 | 0.881 | 0.9258 | 0.9036 | 0.9376 | 0.9198 | 0.9467 |
|
|
| 0.304 | 72.0 | 16488 | 0.2442 | 0.903 | 0.987 | 0.9698 | 0.0034 | 0.8363 | 0.9081 | 0.3847 | 0.9018 | 0.9352 | 0.0167 | 0.8818 | 0.9404 | 0.9112 | 0.9385 | 0.9058 | 0.938 | 0.8752 | 0.9186 | 0.9004 | 0.9335 | 0.9226 | 0.9475 |
|
|
| 0.3017 | 73.0 | 16717 | 0.2676 | 0.8941 | 0.9846 | 0.9587 | 0.0084 | 0.8202 | 0.8994 | 0.3801 | 0.8937 | 0.9293 | 0.0083 | 0.87 | 0.9359 | 0.9087 | 0.937 | 0.8989 | 0.9333 | 0.8619 | 0.9114 | 0.884 | 0.9229 | 0.9169 | 0.9419 |
|
|
| 0.3017 | 74.0 | 16946 | 0.2373 | 0.903 | 0.9862 | 0.9702 | 0.0 | 0.7937 | 0.9116 | 0.3851 | 0.8997 | 0.9344 | 0.0 | 0.8474 | 0.9419 | 0.9126 | 0.9385 | 0.9112 | 0.9396 | 0.8675 | 0.9163 | 0.9068 | 0.9337 | 0.917 | 0.9439 |
|
|
| 0.2849 | 75.0 | 17175 | 0.2357 | 0.9066 | 0.987 | 0.9718 | 0.0 | 0.8228 | 0.9138 | 0.388 | 0.9034 | 0.9373 | 0.0 | 0.8698 | 0.9439 | 0.9141 | 0.9398 | 0.9108 | 0.9387 | 0.8752 | 0.9183 | 0.9063 | 0.9386 | 0.9265 | 0.9513 |
|
|
| 0.2849 | 76.0 | 17404 | 0.2351 | 0.9061 | 0.986 | 0.9681 | 0.1346 | 0.8157 | 0.9135 | 0.3849 | 0.9031 | 0.9369 | 0.325 | 0.8683 | 0.9434 | 0.91 | 0.9381 | 0.9141 | 0.9436 | 0.8761 | 0.9196 | 0.905 | 0.9299 | 0.9252 | 0.9531 |
|
|
| 0.2899 | 77.0 | 17633 | 0.2298 | 0.9137 | 0.9872 | 0.9734 | 0.0 | 0.8293 | 0.9202 | 0.3871 | 0.9096 | 0.9434 | 0.0 | 0.8766 | 0.9497 | 0.9192 | 0.9454 | 0.9188 | 0.9461 | 0.8862 | 0.9286 | 0.9181 | 0.9422 | 0.926 | 0.955 |
|
|
| 0.2899 | 78.0 | 17862 | 0.2373 | 0.9104 | 0.9886 | 0.9733 | 0.35 | 0.8262 | 0.9174 | 0.3891 | 0.9066 | 0.9403 | 0.35 | 0.8769 | 0.9464 | 0.9096 | 0.937 | 0.9154 | 0.9429 | 0.8764 | 0.9227 | 0.9166 | 0.9439 | 0.9342 | 0.9552 |
|
|
| 0.2693 | 79.0 | 18091 | 0.2322 | 0.9124 | 0.9879 | 0.9708 | 0.0 | 0.8266 | 0.9192 | 0.3883 | 0.9064 | 0.9413 | 0.0 | 0.8753 | 0.9479 | 0.9163 | 0.9405 | 0.9172 | 0.9445 | 0.872 | 0.9175 | 0.9235 | 0.9467 | 0.933 | 0.957 |
|
|
| 0.2693 | 80.0 | 18320 | 0.2238 | 0.9089 | 0.9866 | 0.9742 | 0.0 | 0.8083 | 0.917 | 0.3856 | 0.9059 | 0.9396 | 0.0 | 0.8627 | 0.947 | 0.9136 | 0.9396 | 0.9164 | 0.9438 | 0.8796 | 0.9245 | 0.9116 | 0.9402 | 0.9232 | 0.9498 |
|
|
| 0.2788 | 81.0 | 18549 | 0.2170 | 0.9152 | 0.9886 | 0.972 | 0.0 | 0.8325 | 0.9226 | 0.3876 | 0.9096 | 0.9429 | 0.0 | 0.8803 | 0.9496 | 0.9193 | 0.9439 | 0.9149 | 0.9416 | 0.8833 | 0.9238 | 0.9195 | 0.9448 | 0.9388 | 0.9605 |
|
|
| 0.2788 | 82.0 | 18778 | 0.2155 | 0.9176 | 0.989 | 0.9729 | 0.015 | 0.8253 | 0.9246 | 0.3904 | 0.9117 | 0.9457 | 0.0444 | 0.8758 | 0.9526 | 0.9229 | 0.9477 | 0.9203 | 0.9455 | 0.8828 | 0.9266 | 0.9315 | 0.953 | 0.9304 | 0.9554 |
|
|
| 0.2722 | 83.0 | 19007 | 0.2300 | 0.9146 | 0.9869 | 0.9712 | 0.0833 | 0.8085 | 0.9234 | 0.39 | 0.9095 | 0.9426 | 0.1667 | 0.8611 | 0.9506 | 0.9219 | 0.9469 | 0.9209 | 0.9486 | 0.8859 | 0.925 | 0.9125 | 0.9414 | 0.9317 | 0.951 |
|
|
| 0.2722 | 84.0 | 19236 | 0.2123 | 0.9149 | 0.9883 | 0.9744 | 0.0 | 0.8187 | 0.9234 | 0.3888 | 0.9085 | 0.9431 | 0.0 | 0.8665 | 0.9504 | 0.9188 | 0.9437 | 0.9197 | 0.9461 | 0.8905 | 0.9296 | 0.9228 | 0.9482 | 0.9228 | 0.9482 |
|
|
| 0.2722 | 85.0 | 19465 | 0.2406 | 0.9132 | 0.9883 | 0.9684 | 0.0 | 0.8322 | 0.9192 | 0.3888 | 0.9084 | 0.9419 | 0.0 | 0.8782 | 0.9479 | 0.9134 | 0.9384 | 0.9185 | 0.9455 | 0.8773 | 0.9221 | 0.9225 | 0.9473 | 0.9343 | 0.9562 |
|
|
| 0.2645 | 86.0 | 19694 | 0.2162 | 0.9146 | 0.9872 | 0.9708 | 0.0 | 0.8075 | 0.9233 | 0.3889 | 0.9099 | 0.9428 | 0.0 | 0.8611 | 0.9508 | 0.9178 | 0.9423 | 0.9216 | 0.9457 | 0.8741 | 0.9202 | 0.9291 | 0.9531 | 0.9305 | 0.9525 |
|
|
| 0.2645 | 87.0 | 19923 | 0.2313 | 0.9084 | 0.9867 | 0.9664 | 0.021 | 0.8051 | 0.9165 | 0.3869 | 0.9034 | 0.9375 | 0.0208 | 0.8589 | 0.9457 | 0.9137 | 0.9389 | 0.9103 | 0.9395 | 0.8742 | 0.9172 | 0.9104 | 0.9367 | 0.9335 | 0.9551 |
|
|
| 0.2632 | 88.0 | 20152 | 0.2140 | 0.9193 | 0.9901 | 0.9727 | 0.0 | 0.816 | 0.9281 | 0.3899 | 0.9123 | 0.9467 | 0.0 | 0.8733 | 0.9544 | 0.9199 | 0.9447 | 0.9223 | 0.9469 | 0.8829 | 0.9278 | 0.9297 | 0.9547 | 0.9416 | 0.9594 |
|
|
| 0.2632 | 89.0 | 20381 | 0.2108 | 0.9206 | 0.9908 | 0.976 | 0.0063 | 0.8369 | 0.9282 | 0.391 | 0.9129 | 0.947 | 0.05 | 0.8829 | 0.9536 | 0.9238 | 0.9483 | 0.9253 | 0.9497 | 0.8896 | 0.9292 | 0.9271 | 0.9495 | 0.937 | 0.9586 |
|
|
| 0.2558 | 90.0 | 20610 | 0.2074 | 0.9226 | 0.9892 | 0.9725 | 0.0 | 0.8464 | 0.928 | 0.3893 | 0.9148 | 0.9487 | 0.0 | 0.891 | 0.9539 | 0.9259 | 0.949 | 0.925 | 0.9484 | 0.8913 | 0.9325 | 0.9404 | 0.961 | 0.9306 | 0.9526 |
|
|
| 0.2558 | 91.0 | 20839 | 0.2065 | 0.9177 | 0.9878 | 0.9746 | 0.0 | 0.8105 | 0.9259 | 0.3885 | 0.9111 | 0.9445 | 0.0 | 0.8607 | 0.9517 | 0.9222 | 0.9467 | 0.9217 | 0.9486 | 0.8915 | 0.9302 | 0.9299 | 0.9499 | 0.9234 | 0.9473 |
|
|
| 0.265 | 92.0 | 21068 | 0.2300 | 0.9179 | 0.9868 | 0.9712 | 0.0097 | 0.8343 | 0.9248 | 0.389 | 0.9108 | 0.9445 | 0.0188 | 0.8792 | 0.9513 | 0.9164 | 0.9403 | 0.9173 | 0.9422 | 0.8884 | 0.9269 | 0.9373 | 0.9595 | 0.9301 | 0.9537 |
|
|
| 0.265 | 93.0 | 21297 | 0.2123 | 0.917 | 0.9855 | 0.971 | 0.0 | 0.8412 | 0.923 | 0.3896 | 0.9118 | 0.9435 | 0.0 | 0.8862 | 0.949 | 0.9235 | 0.9473 | 0.925 | 0.9516 | 0.8916 | 0.9309 | 0.9297 | 0.9518 | 0.9151 | 0.936 |
|
|
| 0.2552 | 94.0 | 21526 | 0.2158 | 0.9163 | 0.9871 | 0.9692 | 0.025 | 0.8201 | 0.9236 | 0.3899 | 0.9089 | 0.9439 | 0.1 | 0.873 | 0.9505 | 0.9188 | 0.9427 | 0.9236 | 0.9469 | 0.8851 | 0.9264 | 0.9271 | 0.9531 | 0.9271 | 0.9506 |
|
|
| 0.2552 | 95.0 | 21755 | 0.2067 | 0.9214 | 0.988 | 0.9719 | 0.0 | 0.8358 | 0.9286 | 0.39 | 0.9138 | 0.9476 | 0.0 | 0.8828 | 0.9537 | 0.9278 | 0.9507 | 0.9285 | 0.9518 | 0.8957 | 0.9347 | 0.9325 | 0.9538 | 0.9228 | 0.9471 |
|
|
| 0.2552 | 96.0 | 21984 | 0.2016 | 0.9214 | 0.9878 | 0.975 | 0.0 | 0.8237 | 0.9293 | 0.3906 | 0.9143 | 0.9484 | 0.0 | 0.8765 | 0.9548 | 0.926 | 0.9492 | 0.9283 | 0.9538 | 0.8922 | 0.9316 | 0.9259 | 0.9513 | 0.9345 | 0.9559 |
|
|
| 0.2594 | 97.0 | 22213 | 0.2237 | 0.9166 | 0.9877 | 0.972 | 0.0333 | 0.83 | 0.9224 | 0.3894 | 0.9092 | 0.9447 | 0.2 | 0.8798 | 0.9506 | 0.9183 | 0.9446 | 0.9215 | 0.9472 | 0.8878 | 0.9291 | 0.9204 | 0.9484 | 0.9348 | 0.9545 |
|
|
| 0.2594 | 98.0 | 22442 | 0.2155 | 0.9158 | 0.9867 | 0.9685 | 0.0 | 0.8188 | 0.9233 | 0.3865 | 0.9102 | 0.9434 | 0.0 | 0.8684 | 0.9503 | 0.9268 | 0.9478 | 0.9204 | 0.9479 | 0.885 | 0.9271 | 0.9187 | 0.9419 | 0.928 | 0.9523 |
|
|
| 0.2586 | 99.0 | 22671 | 0.2212 | 0.918 | 0.9888 | 0.9709 | 0.0333 | 0.833 | 0.9245 | 0.39 | 0.9105 | 0.9444 | 0.1 | 0.8802 | 0.9506 | 0.9185 | 0.9424 | 0.927 | 0.9502 | 0.8793 | 0.9223 | 0.9301 | 0.9513 | 0.9351 | 0.9558 |
|
|
| 0.2586 | 100.0 | 22900 | 0.2233 | 0.9186 | 0.9888 | 0.9702 | 0.0168 | 0.8326 | 0.9267 | 0.39 | 0.9118 | 0.9461 | 0.0167 | 0.883 | 0.953 | 0.9208 | 0.9447 | 0.9227 | 0.9476 | 0.8797 | 0.9232 | 0.93 | 0.9552 | 0.94 | 0.9599 |
|
|
|
|
|
|
### Framework versions
|
|
|
|
- Transformers 4.42.3
|
|
- Pytorch 2.3.1+cu121
|
|
- Datasets 2.20.0
|
|
- Tokenizers 0.19.1
|
|
|
