metadata

license: other
base_model: nvidia/mit-b0
tags:
  - vision
  - image-segmentation
  - generated_from_trainer
model-index:
  - name: segformer-b0-finetuned-segments-sidewalk-oct-22
    results: []

segformer-b0-finetuned-segments-sidewalk-oct-22

This model is a fine-tuned version of nvidia/mit-b0 on the segments/sidewalk-semantic dataset. It achieves the following results on the evaluation set:

Loss: 0.8205
Mean Iou: 0.1912
Mean Accuracy: 0.2374
Overall Accuracy: 0.7870
Accuracy Unlabeled: nan
Accuracy Flat-road: 0.8060
Accuracy Flat-sidewalk: 0.9462
Accuracy Flat-crosswalk: 0.0
Accuracy Flat-cyclinglane: 0.5762
Accuracy Flat-parkingdriveway: 0.2892
Accuracy Flat-railtrack: nan
Accuracy Flat-curb: 0.1372
Accuracy Human-person: 0.0
Accuracy Human-rider: 0.0
Accuracy Vehicle-car: 0.9165
Accuracy Vehicle-truck: 0.0
Accuracy Vehicle-bus: 0.0
Accuracy Vehicle-tramtrain: 0.0
Accuracy Vehicle-motorcycle: 0.0
Accuracy Vehicle-bicycle: 0.0
Accuracy Vehicle-caravan: 0.0
Accuracy Vehicle-cartrailer: 0.0
Accuracy Construction-building: 0.8735
Accuracy Construction-door: 0.0
Accuracy Construction-wall: 0.2350
Accuracy Construction-fenceguardrail: 0.0103
Accuracy Construction-bridge: 0.0
Accuracy Construction-tunnel: nan
Accuracy Construction-stairs: 0.0
Accuracy Object-pole: 0.0207
Accuracy Object-trafficsign: 0.0
Accuracy Object-trafficlight: 0.0
Accuracy Nature-vegetation: 0.9298
Accuracy Nature-terrain: 0.8976
Accuracy Sky: 0.9572
Accuracy Void-ground: 0.0
Accuracy Void-dynamic: 0.0
Accuracy Void-static: 0.0007
Accuracy Void-unclear: 0.0
Iou Unlabeled: nan
Iou Flat-road: 0.5959
Iou Flat-sidewalk: 0.8090
Iou Flat-crosswalk: 0.0
Iou Flat-cyclinglane: 0.5222
Iou Flat-parkingdriveway: 0.2225
Iou Flat-railtrack: nan
Iou Flat-curb: 0.1299
Iou Human-person: 0.0
Iou Human-rider: 0.0
Iou Vehicle-car: 0.6616
Iou Vehicle-truck: 0.0
Iou Vehicle-bus: 0.0
Iou Vehicle-tramtrain: 0.0
Iou Vehicle-motorcycle: 0.0
Iou Vehicle-bicycle: 0.0
Iou Vehicle-caravan: 0.0
Iou Vehicle-cartrailer: 0.0
Iou Construction-building: 0.5911
Iou Construction-door: 0.0
Iou Construction-wall: 0.2088
Iou Construction-fenceguardrail: 0.0103
Iou Construction-bridge: 0.0
Iou Construction-tunnel: nan
Iou Construction-stairs: 0.0
Iou Object-pole: 0.0206
Iou Object-trafficsign: 0.0
Iou Object-trafficlight: 0.0
Iou Nature-vegetation: 0.7950
Iou Nature-terrain: 0.6650
Iou Sky: 0.8853
Iou Void-ground: 0.0
Iou Void-dynamic: 0.0
Iou Void-static: 0.0006
Iou Void-unclear: 0.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 6e-05
train_batch_size: 2
eval_batch_size: 2
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 3

Training results

Training Loss	Epoch	Step	Validation Loss	Mean Iou	Mean Accuracy	Overall Accuracy	Accuracy Unlabeled	Accuracy Flat-road	Accuracy Flat-sidewalk	Accuracy Flat-crosswalk	Accuracy Flat-cyclinglane	Accuracy Flat-parkingdriveway	Accuracy Flat-railtrack	Accuracy Flat-curb	Accuracy Human-person	Accuracy Vehicle-car	Accuracy Construction-building	Accuracy Construction-wall	Accuracy Construction-fenceguardrail	Accuracy Construction-tunnel	Accuracy Object-pole	Accuracy Nature-vegetation	Accuracy Nature-terrain	Accuracy Sky	Accuracy Void-ground	Accuracy Void-dynamic	Accuracy Void-static	Iou Unlabeled	Iou Flat-road	Iou Flat-sidewalk	Iou Flat-crosswalk	Iou Flat-cyclinglane	Iou Flat-parkingdriveway	Iou Flat-railtrack	Iou Flat-curb	Iou Human-person	Iou Vehicle-car	Iou Construction-building	Iou Construction-wall	Iou Construction-fenceguardrail	Iou Construction-tunnel	Iou Object-pole	Iou Nature-vegetation	Iou Nature-terrain	Iou Sky	Iou Void-ground	Iou Void-dynamic	Iou Void-static
3.0344	0.05	20	3.2785	0.0660	0.1145	0.5080	nan	0.0286	0.8074	0.0003	0.0514	0.0021	nan	0.0	0.0151	0.7902	0.3593	0.0058	0.0013	nan	0.0059	0.9358	0.1013	0.3657	0.0009	0.0023	0.1913	0.0	0.0266	0.5726	0.0003	0.0380	0.0021	0.0	0.0	0.0062	0.4125	0.2842	0.0054	0.0012	0.0	0.0022	0.5146	0.0706	0.3331	0.0009	0.0008	0.0389
2.613	0.1	40	2.4625	0.0703	0.1172	0.5601	nan	0.2214	0.8690	0.0001	0.0012	0.0007	nan	0.0	0.0	0.8179	0.5076	0.0000	0.0007	nan	0.0163	0.9858	0.0895	0.2402	0.0	0.0	0.0012	nan	0.1743	0.6050	0.0001	0.0012	0.0007	nan	0.0	0.0	0.3520	0.3723	0.0000	0.0007	0.0	0.0086	0.5042	0.0595	0.2388	0.0	0.0	0.0011
2.0538	0.15	60	2.1700	0.1015	0.1462	0.6281	nan	0.4778	0.8740	0.0	0.0004	0.0001	nan	0.0	0.0	0.8473	0.7761	0.0	0.0	nan	0.0019	0.9629	0.1345	0.6048	0.0	0.0	0.0	nan	0.3109	0.6422	0.0	0.0004	0.0001	nan	0.0	0.0	0.5365	0.4576	0.0	0.0	nan	0.0017	0.6049	0.0972	0.5971	0.0	0.0	0.0
2.2012	0.2	80	1.8887	0.1185	0.1661	0.6687	nan	0.6100	0.8959	0.0	0.0002	0.0005	nan	0.0	0.0	0.9058	0.7497	0.0000	0.0	nan	0.0003	0.9552	0.3603	0.8387	0.0	0.0	0.0000	nan	0.3640	0.6910	0.0	0.0002	0.0005	nan	0.0	0.0	0.4923	0.4872	0.0000	0.0	nan	0.0003	0.6719	0.2920	0.7928	0.0	0.0	0.0000
1.8908	0.25	100	1.7540	0.1288	0.1744	0.6843	nan	0.6032	0.9146	0.0	0.0004	0.0	nan	0.0	0.0	0.8872	0.8525	0.0	0.0	nan	0.0	0.9141	0.5837	0.8237	0.0	0.0	0.0	nan	0.3655	0.6936	0.0	0.0004	0.0	nan	0.0	0.0	0.5745	0.4759	0.0	0.0	nan	0.0	0.7370	0.4760	0.7981	0.0	0.0	0.0
1.6295	0.3	120	1.6573	0.1321	0.1797	0.6886	nan	0.6838	0.8819	0.0	0.0002	0.0002	nan	0.0	0.0	0.8767	0.8359	0.0	0.0	nan	0.0	0.9300	0.6555	0.8848	0.0	0.0	0.0	nan	0.3759	0.7034	0.0	0.0002	0.0002	nan	0.0	0.0	0.5728	0.4867	0.0	0.0	nan	0.0	0.7394	0.5249	0.8232	0.0	0.0	0.0
1.4891	0.35	140	1.5579	0.1310	0.1783	0.6944	nan	0.7201	0.8884	0.0	0.0030	0.0001	nan	0.0	0.0	0.8757	0.8378	0.0	0.0	nan	0.0	0.9563	0.5210	0.9034	0.0	0.0	0.0	nan	0.4092	0.7265	0.0	0.0030	0.0001	nan	0.0	0.0	0.5723	0.4981	0.0	0.0	nan	0.0	0.6989	0.4428	0.8409	0.0	0.0	0.0
1.5695	0.4	160	1.4544	0.1396	0.1878	0.7096	nan	0.6025	0.9527	0.0	0.0975	0.0000	nan	0.0	0.0	0.9111	0.8360	0.0	0.0	nan	0.0	0.8770	0.8080	0.9245	0.0	0.0	0.0	nan	0.4255	0.7027	0.0	0.0970	0.0000	nan	0.0	0.0	0.5630	0.5198	0.0	0.0	nan	0.0	0.7464	0.5716	0.8424	0.0	0.0	0.0
1.6222	0.45	180	1.3876	0.1429	0.1881	0.7135	nan	0.7565	0.8988	0.0	0.1457	0.0000	nan	0.0	0.0	0.8611	0.8042	0.0	0.0	nan	0.0000	0.9584	0.6861	0.9093	0.0	0.0	0.0	nan	0.4343	0.7345	0.0	0.1445	0.0000	nan	0.0	0.0	0.6140	0.5214	0.0	0.0	nan	0.0000	0.7063	0.5765	0.8421	0.0	0.0	0.0
1.5213	0.5	200	1.3347	0.1437	0.1912	0.7175	nan	0.7966	0.8948	0.0	0.1280	0.0001	nan	0.0	0.0	0.8899	0.7904	0.0	0.0	nan	0.0	0.9511	0.7569	0.9111	0.0	0.0	0.0	nan	0.4368	0.7480	0.0	0.1273	0.0001	nan	0.0	0.0	0.5884	0.5327	0.0	0.0	nan	0.0	0.7227	0.5942	0.8483	0.0	0.0	0.0
1.5815	0.55	220	1.2830	0.1478	0.1933	0.7305	nan	0.6904	0.9574	0.0	0.1857	0.0002	nan	0.0	0.0	0.9084	0.8306	0.0	0.0	nan	0.0000	0.9229	0.7662	0.9246	0.0	0.0	0.0	nan	0.4913	0.7311	0.0	0.1835	0.0002	nan	0.0	0.0	0.5616	0.5288	0.0	0.0	nan	0.0000	0.7565	0.6257	0.8514	0.0	0.0	0.0
1.3495	0.6	240	1.2556	0.1542	0.2016	0.7401	nan	0.7581	0.9240	0.0	0.3392	0.0003	nan	0.0	0.0	0.8641	0.8703	0.0	0.0	nan	0.0	0.9260	0.8520	0.9166	0.0	0.0	0.0	nan	0.5103	0.7582	0.0	0.3288	0.0003	nan	0.0	0.0	0.5999	0.5142	0.0	0.0	nan	0.0	0.7489	0.6277	0.8476	0.0	0.0	0.0
1.4165	0.65	260	1.2116	0.1564	0.2051	0.7459	nan	0.7789	0.9279	0.0	0.3985	0.0033	nan	0.0	0.0	0.9057	0.8510	0.0	0.0	nan	0.0	0.9161	0.8591	0.9229	0.0	0.0	0.0	nan	0.5211	0.7700	0.0	0.3795	0.0033	nan	0.0	0.0	0.5803	0.5283	0.0	0.0	nan	0.0	0.7511	0.6205	0.8517	0.0	0.0	0.0
1.6014	0.7	280	1.1417	0.1568	0.2001	0.7461	nan	0.7075	0.9589	0.0	0.4195	0.0036	nan	0.0	0.0	0.8856	0.8297	0.0000	0.0	nan	0.0000	0.9453	0.7286	0.9236	0.0	0.0	0.0	nan	0.5315	0.7537	0.0	0.3857	0.0035	nan	0.0	0.0	0.5986	0.5321	0.0000	0.0	nan	0.0000	0.7376	0.6149	0.8599	0.0	0.0	0.0
1.0657	0.75	300	1.1932	0.1491	0.1996	0.7295	nan	0.8205	0.9079	0.0	0.1982	0.0001	nan	0.0	0.0	0.8932	0.8422	0.0000	0.0	nan	0.0	0.8842	0.8971	0.9425	0.0	0.0	0.0	nan	0.4513	0.7701	0.0	0.1964	0.0001	nan	0.0	0.0	0.6328	0.5365	0.0000	0.0	nan	0.0	0.7527	0.5770	0.8536	0.0	0.0	0.0
1.0489	0.8	320	1.1246	0.1579	0.2052	0.7487	nan	0.7758	0.9321	0.0	0.4135	0.0034	nan	0.0	0.0	0.9132	0.8774	0.0	0.0	nan	0.0	0.9190	0.7974	0.9346	0.0	0.0	0.0	nan	0.5130	0.7765	0.0	0.3864	0.0034	nan	0.0	0.0	0.5971	0.5242	0.0	0.0	nan	0.0	0.7665	0.6439	0.8423	0.0	0.0	0.0
1.5638	0.85	340	1.1140	0.1593	0.2055	0.7523	nan	0.7516	0.9477	0.0	0.4362	0.0104	nan	0.0000	0.0	0.8985	0.8186	0.0006	0.0	nan	0.0000	0.9420	0.8408	0.9295	0.0	0.0	0.0000	nan	0.5424	0.7660	0.0	0.4047	0.0102	nan	0.0000	0.0	0.6019	0.5592	0.0006	0.0	nan	0.0000	0.7376	0.6128	0.8628	0.0	0.0	0.0000
1.1776	0.9	360	1.0707	0.1620	0.2080	0.7556	nan	0.7588	0.9374	0.0	0.5169	0.0077	nan	0.0000	0.0	0.8884	0.8878	0.0	0.0	nan	0.0	0.9295	0.7984	0.9324	0.0	0.0	0.0	nan	0.5349	0.7831	0.0	0.4307	0.0076	nan	0.0000	0.0	0.6297	0.5240	0.0	0.0	nan	0.0	0.7673	0.6460	0.8607	0.0	0.0	0.0
1.2379	0.95	380	1.0703	0.1594	0.2063	0.7513	nan	0.8500	0.9162	0.0	0.3756	0.0084	nan	0.0000	0.0	0.8808	0.8357	0.0011	0.0	nan	0.0000	0.9440	0.8566	0.9337	0.0	0.0	0.0	nan	0.5019	0.7946	0.0	0.3577	0.0082	nan	0.0000	0.0	0.6323	0.5476	0.0011	0.0	nan	0.0000	0.7520	0.6421	0.8617	0.0	0.0	0.0
1.2458	1.0	400	1.0662	0.1615	0.2087	0.7558	nan	0.7929	0.9473	0.0	0.4294	0.0103	nan	0.0	0.0	0.9013	0.8872	0.0043	0.0	nan	0.0	0.8873	0.8934	0.9253	0.0	0.0	0.0	nan	0.5344	0.7801	0.0	0.4025	0.0101	nan	0.0	0.0	0.6306	0.5374	0.0043	0.0	nan	0.0	0.7776	0.6274	0.8639	0.0	0.0	0.0
1.1771	1.05	420	1.0356	0.1603	0.2083	0.7534	nan	0.7536	0.9561	0.0	0.4531	0.0177	nan	0.0	0.0	0.8970	0.8564	0.0080	0.0	nan	0.0002	0.8820	0.8957	0.9467	0.0	0.0	0.0	nan	0.5444	0.7694	0.0	0.4170	0.0173	nan	0.0	0.0	0.6175	0.5506	0.0080	0.0	nan	0.0002	0.7505	0.5961	0.8599	0.0	0.0	0.0
1.6228	1.1	440	1.0142	0.1621	0.2080	0.7567	nan	0.7339	0.9441	0.0	0.5419	0.0236	nan	0.0000	0.0	0.8966	0.8471	0.0008	0.0	nan	0.0002	0.9528	0.7766	0.9374	0.0	0.0	0.0	nan	0.5463	0.7793	0.0	0.4414	0.0228	nan	0.0000	0.0	0.5976	0.5471	0.0008	0.0	nan	0.0002	0.7484	0.6349	0.8673	0.0	0.0	0.0
1.0048	1.15	460	1.0068	0.1639	0.2111	0.7569	nan	0.8128	0.9349	0.0	0.4943	0.0336	nan	0.0	0.0	0.8689	0.8799	0.0182	0.0	nan	0.0	0.8916	0.8868	0.9328	0.0	0.0	0.0	nan	0.5359	0.7881	0.0	0.4307	0.0320	nan	0.0	0.0	0.6679	0.5443	0.0182	0.0	nan	0.0	0.7584	0.6021	0.8680	0.0	0.0	0.0
1.2324	1.2	480	0.9910	0.1654	0.2122	0.7616	nan	0.7681	0.9474	0.0	0.5180	0.0362	nan	0.0	0.0	0.9269	0.8841	0.0166	0.0	nan	0.0002	0.9114	0.8465	0.9359	0.0	0.0	0.0	nan	0.5440	0.7851	0.0	0.4523	0.0342	nan	0.0	0.0	0.6220	0.5470	0.0166	0.0	nan	0.0002	0.7809	0.6369	0.8732	0.0	0.0	0.0
1.2671	1.25	500	0.9752	0.1656	0.2122	0.7615	nan	0.7892	0.9471	0.0	0.4901	0.0372	nan	0.0000	0.0	0.8909	0.9073	0.0144	0.0	nan	0.0001	0.8914	0.8852	0.9376	0.0	0.0	0.0	nan	0.5567	0.7852	0.0	0.4420	0.0356	nan	0.0000	0.0	0.6601	0.5375	0.0144	0.0	nan	0.0001	0.7767	0.6218	0.8682	0.0	0.0	0.0
0.7255	1.3	520	0.9784	0.1657	0.2109	0.7613	nan	0.7502	0.9543	0.0	0.5271	0.0300	nan	0.0003	0.0	0.9243	0.8146	0.0498	0.0001	nan	0.0004	0.9484	0.8179	0.9302	0.0	0.0	0.0000	nan	0.5602	0.7779	0.0	0.4538	0.0287	nan	0.0003	0.0	0.6083	0.5646	0.0484	0.0001	nan	0.0004	0.7446	0.6422	0.8735	0.0	0.0	0.0000
0.706	1.35	540	0.9514	0.1681	0.2146	0.7657	nan	0.8300	0.9317	0.0	0.5056	0.0573	nan	0.0007	0.0	0.9088	0.8888	0.0319	0.0	nan	0.0	0.9270	0.8430	0.9424	0.0	0.0	0.0	nan	0.5602	0.7976	0.0	0.4449	0.0538	nan	0.0007	0.0	0.6372	0.5417	0.0313	0.0	nan	0.0	0.7809	0.6578	0.8720	0.0	0.0	0.0
2.7306	1.4	560	0.9422	0.1658	0.2124	0.7626	nan	0.8142	0.9289	0.0	0.5269	0.0589	nan	0.0007	0.0	0.9010	0.8538	0.0218	0.0	nan	0.0001	0.9510	0.8063	0.9344	0.0	0.0	0.0000	nan	0.5546	0.7957	0.0	0.4545	0.0555	nan	0.0007	0.0	0.6319	0.5580	0.0216	0.0	nan	0.0001	0.7529	0.6068	0.8736	0.0	0.0	0.0000
0.7776	1.45	580	0.9354	0.1692	0.2173	0.7671	nan	0.8180	0.9364	0.0	0.5362	0.0723	nan	0.0006	0.0	0.9295	0.8552	0.0647	0.0	nan	0.0000	0.9218	0.8615	0.9572	0.0	0.0	0.0	nan	0.5470	0.7981	0.0	0.4722	0.0664	nan	0.0006	0.0	0.5879	0.5695	0.0633	0.0	nan	0.0000	0.7839	0.6627	0.8644	0.0	0.0	0.0
1.152	1.5	600	0.9245	0.1713	0.2162	0.7686	nan	0.7912	0.9437	0.0	0.5262	0.0980	nan	0.0083	0.0	0.9232	0.8927	0.0392	0.0	nan	0.0001	0.9323	0.8369	0.9261	0.0	0.0	0.0	nan	0.5701	0.7885	0.0	0.4667	0.0881	nan	0.0083	0.0	0.6225	0.5544	0.0383	0.0	nan	0.0001	0.7813	0.6868	0.8772	0.0	0.0	0.0
0.8262	1.55	620	0.9176	0.1730	0.2198	0.7674	nan	0.8019	0.9381	0.0	0.5535	0.0878	nan	0.0022	0.0	0.8948	0.8845	0.1280	0.0003	nan	0.0001	0.9024	0.8930	0.9461	0.0	0.0	0.0	nan	0.5552	0.7902	0.0	0.4732	0.0802	nan	0.0022	0.0	0.6629	0.5612	0.1206	0.0003	nan	0.0001	0.7751	0.6375	0.8783	0.0	0.0	0.0
0.6903	1.6	640	0.9208	0.1716	0.2206	0.7650	nan	0.8565	0.9001	0.0	0.5462	0.1496	nan	0.0031	0.0	0.9177	0.8573	0.0616	0.0000	nan	0.0003	0.9424	0.8718	0.9531	0.0	0.0	0.0	nan	0.5363	0.8015	0.0	0.4726	0.1256	nan	0.0031	0.0	0.6017	0.5674	0.0598	0.0000	nan	0.0003	0.7748	0.6742	0.8742	0.0	0.0	0.0
1.5866	1.65	660	0.9145	0.1733	0.2168	0.7694	nan	0.7600	0.9540	0.0	0.5183	0.1186	nan	0.0061	0.0	0.8883	0.8572	0.0659	0.0004	nan	0.0010	0.9456	0.8645	0.9568	0.0	0.0	0.0	nan	0.5764	0.7745	0.0	0.4761	0.1011	nan	0.0061	0.0	0.6573	0.5704	0.0641	0.0004	nan	0.0010	0.7710	0.6742	0.8719	0.0	0.0	0.0
0.8875	1.7	680	0.8911	0.1753	0.2213	0.7723	nan	0.8538	0.9253	0.0	0.5179	0.1341	nan	0.0173	0.0	0.8952	0.8833	0.0861	0.0011	nan	0.0018	0.9337	0.8725	0.9605	0.0	0.0	0.0000	nan	0.5537	0.8057	0.0	0.4707	0.1151	nan	0.0172	0.0	0.6591	0.5667	0.0820	0.0011	nan	0.0018	0.7846	0.6832	0.8686	0.0	0.0	0.0000
1.5167	1.75	700	0.8953	0.1735	0.2189	0.7719	nan	0.7832	0.9589	0.0	0.5138	0.1066	nan	0.0083	0.0	0.9367	0.8818	0.0813	0.0	nan	0.0026	0.9102	0.8700	0.9514	0.0	0.0	0.0	nan	0.5839	0.7821	0.0	0.4746	0.0928	nan	0.0083	0.0	0.5941	0.5707	0.0780	0.0	nan	0.0026	0.7990	0.6861	0.8793	0.0	0.0	0.0
0.9979	1.8	720	0.8751	0.1777	0.2241	0.7744	nan	0.8386	0.9354	0.0	0.5054	0.1933	nan	0.0106	0.0	0.9022	0.8762	0.1373	0.0025	nan	0.0018	0.9246	0.9029	0.9406	0.0	0.0	0.0002	nan	0.5668	0.8039	0.0	0.4699	0.1569	nan	0.0105	0.0	0.6565	0.5768	0.1293	0.0025	nan	0.0018	0.7831	0.6476	0.8808	0.0	0.0	0.0002
1.0187	1.85	740	0.8824	0.1775	0.2235	0.7756	nan	0.7729	0.9506	0.0	0.5806	0.1631	nan	0.0408	0.0	0.9034	0.8571	0.0936	0.0016	nan	0.0023	0.9354	0.8886	0.9610	0.0	0.0	0.0	nan	0.5905	0.7954	0.0	0.4912	0.1380	nan	0.0402	0.0	0.6580	0.5717	0.0897	0.0016	nan	0.0023	0.7706	0.6591	0.8710	0.0	0.0	0.0
0.9611	1.9	760	0.8828	0.1772	0.2238	0.7760	nan	0.7868	0.9491	0.0	0.5407	0.2091	nan	0.0242	0.0	0.9233	0.8631	0.0904	0.0009	nan	0.0035	0.9350	0.8849	0.9505	0.0	0.0	0.0000	nan	0.5839	0.7986	0.0	0.4906	0.1646	nan	0.0241	0.0	0.5966	0.5802	0.0869	0.0009	nan	0.0035	0.7864	0.6729	0.8806	0.0	0.0	0.0000
2.1155	1.95	780	0.8815	0.1770	0.2237	0.7731	nan	0.7660	0.9513	0.0	0.5447	0.2112	nan	0.0432	0.0	0.9072	0.8731	0.0845	0.0000	nan	0.0061	0.9165	0.9091	0.9441	0.0	0.0	0.0001	nan	0.5932	0.7908	0.0	0.4903	0.1697	nan	0.0425	0.0	0.6556	0.5706	0.0820	0.0000	nan	0.0061	0.7673	0.6144	0.8812	0.0	0.0	0.0001
0.6024	2.0	800	0.8777	0.1820	0.2279	0.7780	nan	0.7736	0.9496	0.0	0.5477	0.2592	nan	0.0533	0.0	0.9081	0.8862	0.1400	0.0020	nan	0.0047	0.9243	0.8911	0.9534	0.0	0.0	0.0001	nan	0.5893	0.7954	0.0	0.4872	0.1926	nan	0.0523	0.0	0.6560	0.5729	0.1306	0.0020	nan	0.0047	0.7937	0.6645	0.8811	0.0	0.0	0.0001
0.8128	2.05	820	0.8642	0.1808	0.2251	0.7771	nan	0.8166	0.9410	0.0	0.5389	0.2094	nan	0.0662	0.0	0.8908	0.8869	0.0996	0.0005	nan	0.0031	0.9331	0.8691	0.9467	0.0	0.0	0.0000	nan	0.5699	0.8014	0.0	0.4802	0.1755	nan	0.0644	0.0	0.6747	0.5633	0.0937	0.0005	nan	0.0031	0.7929	0.6843	0.8816	0.0	0.0	0.0000
0.6234	2.1	840	0.8738	0.1802	0.2251	0.7772	nan	0.7792	0.9517	0.0	0.5278	0.2151	nan	0.0813	0.0	0.9093	0.8962	0.0800	0.0002	nan	0.0017	0.9256	0.8842	0.9506	0.0	0.0	0.0	nan	0.5836	0.7938	0.0	0.4830	0.1780	nan	0.0786	0.0	0.6562	0.5606	0.0769	0.0002	nan	0.0017	0.7975	0.6755	0.8816	0.0	0.0	0.0
1.0248	2.15	860	0.8557	0.1833	0.2295	0.7801	nan	0.8362	0.9322	0.0	0.5321	0.2485	nan	0.0973	0.0	0.9133	0.8781	0.1243	0.0045	nan	0.0052	0.9406	0.8790	0.9517	0.0	0.0	0.0004	nan	0.5790	0.8108	0.0	0.4847	0.1990	nan	0.0935	0.0	0.6502	0.5722	0.1164	0.0045	nan	0.0052	0.7906	0.6770	0.8829	0.0	0.0	0.0004
0.5912	2.2	880	0.8511	0.1845	0.2284	0.7808	nan	0.7845	0.9575	0.0	0.5220	0.2382	nan	0.0680	0.0	0.9117	0.8886	0.1838	0.0017	nan	0.0026	0.9264	0.8725	0.9506	0.0	0.0	0.0001	nan	0.5900	0.7918	0.0	0.4821	0.1888	nan	0.0659	0.0	0.6543	0.5807	0.1674	0.0017	nan	0.0026	0.8021	0.6929	0.8820	0.0	0.0	0.0001
0.6886	2.25	900	0.8437	0.1852	0.2304	0.7822	nan	0.8083	0.9456	0.0	0.5593	0.2461	nan	0.0786	0.0	0.9091	0.8611	0.1755	0.0106	nan	0.0085	0.9442	0.8737	0.9499	0.0	0.0	0.0009	nan	0.5843	0.8063	0.0	0.5006	0.1975	nan	0.0762	0.0	0.6453	0.5900	0.1613	0.0106	nan	0.0085	0.7830	0.6792	0.8820	0.0	0.0	0.0009
0.6724	2.3	920	0.8433	0.1860	0.2320	0.7823	nan	0.8110	0.9430	0.0	0.5671	0.2544	nan	0.0851	0.0	0.9074	0.8890	0.1793	0.0092	nan	0.0065	0.9220	0.8978	0.9508	0.0	0.0	0.0003	nan	0.5822	0.8078	0.0	0.5064	0.2046	nan	0.0821	0.0	0.6679	0.5792	0.1641	0.0092	nan	0.0065	0.7915	0.6674	0.8842	0.0	0.0	0.0003
0.6496	2.35	940	0.8444	0.1868	0.2318	0.7824	nan	0.7763	0.9546	0.0	0.5181	0.2847	nan	0.1250	0.0	0.9190	0.8823	0.1610	0.0190	nan	0.0083	0.9333	0.8867	0.9488	0.0	0.0	0.0006	nan	0.5965	0.8000	0.0	0.4823	0.2113	nan	0.1186	0.0	0.6549	0.5781	0.1491	0.0190	nan	0.0083	0.7934	0.6791	0.8869	0.0	0.0	0.0006
1.0204	2.4	960	0.8418	0.1865	0.2329	0.7830	nan	0.7867	0.9520	0.0	0.5531	0.2595	nan	0.1205	0.0	0.9290	0.8814	0.1701	0.0207	nan	0.0103	0.9224	0.8945	0.9536	0.0	0.0	0.0007	nan	0.5938	0.8041	0.0	0.4984	0.2053	nan	0.1150	0.0	0.6324	0.5836	0.1562	0.0207	nan	0.0102	0.7962	0.6669	0.8850	0.0	0.0	0.0007
1.031	2.45	980	0.8378	0.1865	0.2330	0.7831	nan	0.8433	0.9345	0.0	0.5633	0.2277	nan	0.1026	0.0	0.9222	0.8776	0.1911	0.0160	nan	0.0148	0.9305	0.8781	0.9537	0.0	0.0	0.0003	nan	0.5731	0.8142	0.0	0.5075	0.1829	nan	0.0981	0.0	0.6242	0.5928	0.1719	0.0160	nan	0.0147	0.8013	0.6845	0.8855	0.0	0.0	0.0003
0.6454	2.5	1000	0.8211	0.1897	0.2360	0.7860	nan	0.8157	0.9375	0.0	0.6042	0.2590	nan	0.1295	0.0	0.9053	0.8906	0.2036	0.0173	nan	0.0164	0.9342	0.8800	0.9564	0.0	0.0	0.0006	nan	0.5925	0.8123	0.0	0.5205	0.2063	nan	0.1224	0.0	0.6621	0.5851	0.1820	0.0173	nan	0.0163	0.7978	0.6693	0.8851	0.0	0.0	0.0006
0.743	2.55	1020	0.8308	0.1892	0.2338	0.7856	nan	0.8081	0.9512	0.0	0.5433	0.2647	nan	0.0964	0.0	0.9065	0.8854	0.2214	0.0173	nan	0.0202	0.9313	0.8755	0.9594	0.0	0.0	0.0004	nan	0.5924	0.8031	0.0	0.5040	0.2078	nan	0.0930	0.0	0.6621	0.5903	0.1972	0.0173	nan	0.0201	0.8011	0.6815	0.8837	0.0	0.0	0.0004
0.7992	2.6	1040	0.8288	0.1895	0.2354	0.7855	nan	0.8204	0.9416	0.0	0.5332	0.3322	nan	0.1337	0.0	0.9157	0.8720	0.1897	0.0098	nan	0.0169	0.9416	0.8724	0.9538	0.0	0.0	0.0003	nan	0.5942	0.8111	0.0	0.4962	0.2383	nan	0.1264	0.0	0.6404	0.5912	0.1734	0.0098	nan	0.0168	0.7929	0.6861	0.8859	0.0	0.0	0.0003
1.1356	2.65	1060	0.8274	0.1906	0.2364	0.7862	nan	0.8149	0.9477	0.0	0.5351	0.3105	nan	0.1312	0.0	0.9154	0.8660	0.2393	0.0120	nan	0.0171	0.9340	0.8868	0.9532	0.0	0.0	0.0012	nan	0.5962	0.8083	0.0	0.4965	0.2326	nan	0.1246	0.0	0.6504	0.5968	0.2118	0.0120	nan	0.0171	0.7920	0.6725	0.8867	0.0	0.0	0.0012
0.5932	2.7	1080	0.8257	0.1903	0.2364	0.7861	nan	0.8290	0.9419	0.0	0.5497	0.2976	nan	0.1197	0.0	0.9087	0.8824	0.2339	0.0075	nan	0.0187	0.9262	0.8949	0.9530	0.0	0.0	0.0009	nan	0.5894	0.8119	0.0	0.5032	0.2249	nan	0.1146	0.0	0.6676	0.5904	0.2065	0.0075	nan	0.0186	0.7986	0.6689	0.8871	0.0	0.0	0.0009
0.661	2.75	1100	0.8188	0.1911	0.2373	0.7862	nan	0.8323	0.9346	0.0	0.5658	0.3215	nan	0.1282	0.0	0.8988	0.8717	0.2269	0.0086	nan	0.0196	0.9387	0.8891	0.9566	0.0	0.0	0.0010	nan	0.5905	0.8147	0.0	0.5080	0.2346	nan	0.1219	0.0	0.6810	0.5885	0.2022	0.0086	nan	0.0195	0.7895	0.6707	0.8858	0.0	0.0	0.0010
0.8891	2.8	1120	0.8187	0.1899	0.2356	0.7857	nan	0.8249	0.9412	0.0	0.5537	0.2970	nan	0.1144	0.0	0.9091	0.8824	0.2141	0.0099	nan	0.0170	0.9309	0.8937	0.9493	0.0	0.0	0.0006	nan	0.5877	0.8112	0.0	0.5056	0.2248	nan	0.1099	0.0	0.6758	0.5865	0.1918	0.0099	nan	0.0170	0.7977	0.6701	0.8885	0.0	0.0	0.0006
0.9464	2.85	1140	0.8197	0.1901	0.2355	0.7858	nan	0.8153	0.9452	0.0	0.5494	0.2843	nan	0.1190	0.0	0.9054	0.8894	0.2231	0.0101	nan	0.0181	0.9267	0.8999	0.9504	0.0	0.0	0.0004	nan	0.5909	0.8082	0.0	0.5072	0.2200	nan	0.1143	0.0	0.6833	0.5829	0.1980	0.0101	nan	0.0180	0.8002	0.6620	0.8880	0.0	0.0	0.0004
0.5214	2.9	1160	0.8243	0.1915	0.2361	0.7869	nan	0.8016	0.9534	0.0	0.5681	0.2683	nan	0.1163	0.0	0.8982	0.8968	0.2615	0.0054	nan	0.0179	0.9167	0.8951	0.9558	0.0	0.0	0.0004	nan	0.5963	0.8027	0.0	0.5200	0.2119	nan	0.1114	0.0	0.6924	0.5836	0.2227	0.0054	nan	0.0179	0.8057	0.6715	0.8857	0.0	0.0	0.0004
0.5897	2.95	1180	0.8193	0.1911	0.2378	0.7867	nan	0.8184	0.9417	0.0	0.5589	0.3065	nan	0.1409	0.0	0.9231	0.8825	0.2340	0.0084	nan	0.0179	0.9257	0.8956	0.9565	0.0	0.0	0.0003	nan	0.5919	0.8119	0.0	0.5141	0.2286	nan	0.1330	0.0	0.6552	0.5886	0.2069	0.0084	nan	0.0179	0.8010	0.6718	0.8861	0.0	0.0	0.0003
1.1597	3.0	1200	0.8205	0.1912	0.2374	0.7870	nan	0.8060	0.9462	0.0	0.5762	0.2892	nan	0.1372	0.0	0.9165	0.8735	0.2350	0.0103	nan	0.0207	0.9298	0.8976	0.9572	0.0	0.0	0.0007	nan	0.5959	0.8090	0.0	0.5222	0.2225	nan	0.1299	0.0	0.6616	0.5911	0.2088	0.0103	nan	0.0206	0.7950	0.6650	0.8853	0.0	0.0	0.0006

Framework versions

Transformers 4.41.2
Pytorch 2.3.1+cpu
Datasets 2.19.2
Tokenizers 0.19.1