SwinV2-Base-Document-Classifier

This model is a fine-tuned version of microsoft/swinv2-base-patch4-window16-256 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3854
• Accuracy: 0.8487
• F1: 0.7828
• Precision: 0.8618
• Recall: 0.7583

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 32
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• training_steps: 10000

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	F1	Precision	Recall
0.8305	0.002	20	0.8968	0.6491	0.6179	0.6249	0.6587
0.2772	0.004	40	0.8381	0.7136	0.6797	0.6799	0.6995
0.207	0.006	60	1.0716	0.6132	0.6170	0.6540	0.6573
0.1773	0.008	80	0.9111	0.7106	0.6759	0.6733	0.7010
0.1392	0.01	100	1.0190	0.7925	0.6899	0.7848	0.6776
0.1146	0.012	120	0.9824	0.7741	0.7229	0.7279	0.7266
0.1069	0.014	140	1.0200	0.8288	0.7446	0.8286	0.7277
0.0842	0.016	160	1.0000	0.8147	0.7473	0.7638	0.7522
0.1098	0.018	180	0.9541	0.8370	0.7656	0.8038	0.7564
0.1523	0.02	200	0.8870	0.7819	0.7366	0.7262	0.7562
0.1103	0.022	220	0.8863	0.8399	0.7712	0.8081	0.7606
0.0915	0.024	240	1.2072	0.8252	0.7164	0.8341	0.7108
0.0841	0.026	260	0.9257	0.8452	0.7832	0.8105	0.7741
0.024	0.028	280	1.2352	0.8378	0.7605	0.8286	0.7449
0.0678	0.03	300	1.2253	0.8378	0.7585	0.8393	0.7410
0.0998	0.032	320	1.0253	0.8346	0.7787	0.7892	0.7749
0.1259	0.034	340	1.2880	0.7690	0.7062	0.7388	0.7089
0.0483	0.036	360	1.2374	0.8474	0.7723	0.8431	0.7582
0.0668	0.038	380	1.0140	0.8438	0.7852	0.8051	0.7778
0.0543	0.04	400	0.9806	0.8401	0.7797	0.7987	0.7750
0.0938	0.042	420	1.1257	0.8423	0.7644	0.8329	0.7520
0.0598	0.044	440	1.1707	0.8348	0.7644	0.8295	0.7456
0.0456	0.046	460	1.1519	0.8458	0.7680	0.8408	0.7591
0.1077	0.048	480	1.3103	0.8227	0.7342	0.8451	0.7143
0.0874	0.05	500	0.9506	0.8476	0.7887	0.8194	0.7792
0.0714	0.052	520	1.1042	0.8427	0.7632	0.8534	0.7454
0.0547	0.054	540	1.1577	0.8401	0.7544	0.8310	0.7520
0.0668	0.056	560	1.2812	0.8405	0.7680	0.8339	0.7514
0.0632	0.058	580	1.2579	0.8476	0.7801	0.8342	0.7653
0.0423	0.06	600	1.2063	0.8415	0.7784	0.8120	0.7718
0.0722	0.062	620	1.1261	0.8495	0.7854	0.8283	0.7763
0.0487	0.064	640	1.3532	0.8313	0.7604	0.8281	0.7403
0.0316	0.066	660	1.1830	0.8460	0.7846	0.8159	0.7826
0.0414	0.068	680	1.2328	0.8429	0.7722	0.8252	0.7595
0.0432	0.07	700	1.2713	0.8482	0.7813	0.8360	0.7708
0.0624	0.072	720	1.1437	0.8525	0.7910	0.8300	0.7853
0.0506	0.074	740	1.2602	0.8380	0.7658	0.8282	0.7557
0.042	0.076	760	1.4864	0.8270	0.7396	0.8332	0.7227
0.0495	0.078	780	1.6550	0.8186	0.7198	0.8443	0.7041
0.09	0.08	800	1.2392	0.8380	0.7692	0.8158	0.7600
0.0743	0.082	820	1.2096	0.8309	0.7665	0.8194	0.7476
0.0608	0.084	840	1.2309	0.8337	0.7644	0.8301	0.7438
0.0223	0.086	860	1.3063	0.8519	0.7788	0.8508	0.7638
0.0348	0.088	880	1.2334	0.8468	0.7822	0.8391	0.7634
0.0572	0.09	900	1.5572	0.8305	0.7433	0.8417	0.7270
0.041	0.092	920	1.2460	0.8536	0.7902	0.8425	0.7746
0.0433	0.094	940	1.3094	0.8470	0.7731	0.8348	0.7617
0.0529	0.096	960	1.6061	0.8235	0.7430	0.8490	0.7185
0.043	0.098	980	1.3444	0.8452	0.7634	0.8513	0.7500
0.0411	0.1	1000	1.4491	0.8423	0.7499	0.8464	0.7418
0.0433	0.102	1020	1.2582	0.8552	0.7828	0.8450	0.7707
0.0444	0.104	1040	1.3154	0.8583	0.7817	0.8596	0.7689
0.0617	0.106	1060	1.4278	0.8415	0.7651	0.8584	0.7439
0.091	0.108	1080	1.1503	0.8538	0.7882	0.8468	0.7711
0.0435	0.11	1100	1.3136	0.8344	0.7634	0.8451	0.7402
0.042	0.112	1120	1.1063	0.8580	0.7933	0.8471	0.7784
0.0283	0.114	1140	1.1147	0.8642	0.8042	0.8521	0.7892
0.0826	0.116	1160	1.0588	0.8529	0.7999	0.8225	0.7895
0.0599	0.118	1180	1.4373	0.8260	0.7519	0.8423	0.7275
0.085	0.12	1200	1.0753	0.8529	0.7837	0.8418	0.7740
0.015	0.122	1220	1.1104	0.8595	0.8030	0.8424	0.7878
0.0258	0.124	1240	1.2051	0.8578	0.7949	0.8533	0.7769
0.1003	0.126	1260	1.1081	0.8507	0.7856	0.8489	0.7658
0.0222	0.128	1280	1.2320	0.8468	0.7814	0.8472	0.7604
0.0212	0.13	1300	1.2915	0.8427	0.7671	0.8478	0.7504
0.0354	0.132	1320	1.5551	0.8276	0.7401	0.8566	0.7192
0.0781	0.134	1340	1.1056	0.8531	0.7902	0.8474	0.7722
0.062	0.136	1360	1.3846	0.8301	0.7402	0.8517	0.7223
0.0491	0.138	1380	1.2179	0.8591	0.7902	0.8582	0.7757
0.0519	0.14	1400	1.1529	0.8419	0.7783	0.8486	0.7559
0.0989	0.142	1420	1.0709	0.8523	0.7786	0.8574	0.7637
0.0772	0.144	1440	1.1710	0.8346	0.7499	0.8470	0.7320
0.0445	0.146	1460	1.0408	0.8583	0.7921	0.8551	0.7757
0.0093	0.148	1480	1.1644	0.8462	0.7757	0.8520	0.7560
0.0375	0.15	1500	1.2751	0.8446	0.7601	0.8569	0.7455
0.046	0.152	1520	1.1101	0.8556	0.7845	0.8599	0.7673
0.0255	0.154	1540	1.2097	0.8409	0.7688	0.8563	0.7462
0.023	0.156	1560	1.4518	0.8078	0.7313	0.8277	0.7036
0.0148	0.158	1580	1.3187	0.8464	0.7749	0.8616	0.7519
0.0605	0.16	1600	1.3435	0.8427	0.7631	0.8645	0.7430
0.0168	0.162	1620	1.3367	0.8491	0.7823	0.8497	0.7627
0.0442	0.164	1640	1.3156	0.8529	0.7831	0.8607	0.7640
0.035	0.166	1660	1.1943	0.8529	0.7931	0.8435	0.7740
0.0595	0.168	1680	1.1160	0.8533	0.7925	0.8381	0.7801
0.0233	0.17	1700	1.2185	0.8435	0.7864	0.8297	0.7675
0.0243	0.172	1720	1.4743	0.8299	0.7507	0.8521	0.7279
0.0207	0.174	1740	1.5421	0.8327	0.7484	0.8562	0.7282
0.0054	0.176	1760	1.5514	0.8440	0.7534	0.8527	0.7433
0.0283	0.178	1780	2.0433	0.7839	0.6810	0.8394	0.6582
0.0289	0.18	1800	1.9418	0.7992	0.6993	0.8478	0.6774
0.0163	0.182	1820	1.5420	0.8429	0.7578	0.8542	0.7436
0.0421	0.184	1840	1.2911	0.8550	0.7887	0.8476	0.7731
0.0493	0.186	1860	1.4809	0.8309	0.7586	0.8370	0.7354
0.0465	0.188	1880	1.3390	0.8464	0.7805	0.8428	0.7607
0.0283	0.19	1900	1.5690	0.8260	0.7472	0.8485	0.7229
0.0365	0.192	1920	1.3759	0.8499	0.7739	0.8554	0.7573
0.0412	0.194	1940	1.3300	0.8517	0.7834	0.8556	0.7632
0.079	0.196	1960	1.1782	0.8556	0.7982	0.8404	0.7817
0.0559	0.198	1980	1.2982	0.8450	0.7787	0.8583	0.7546
0.0106	0.2	2000	1.2293	0.8548	0.7950	0.8453	0.7761
0.0285	0.202	2020	1.3538	0.8536	0.7830	0.8571	0.7650
0.015	0.204	2040	1.3771	0.8450	0.7801	0.8410	0.7600
0.0374	0.206	2060	1.3766	0.8413	0.7737	0.8401	0.7529
0.0518	0.208	2080	1.3408	0.8311	0.7655	0.8419	0.7403
0.0323	0.21	2100	1.4204	0.8399	0.7713	0.8537	0.7465
0.0309	0.212	2120	1.3761	0.8344	0.7664	0.8409	0.7424
0.0453	0.214	2140	1.3741	0.8380	0.7628	0.8430	0.7429
0.0326	0.216	2160	1.5718	0.7958	0.7227	0.8051	0.6957
0.0843	0.218	2180	1.1338	0.8531	0.7869	0.8421	0.7720
0.0279	0.22	2200	1.5665	0.7982	0.7249	0.8327	0.6934
0.0467	0.222	2220	1.2442	0.8472	0.7781	0.8465	0.7578
0.0691	0.224	2240	1.2314	0.8362	0.7681	0.8331	0.7464
0.0471	0.226	2260	1.2135	0.8468	0.7784	0.8440	0.7591
0.0716	0.228	2280	1.2434	0.8348	0.7652	0.8413	0.7424
0.0274	0.23	2300	1.2170	0.8540	0.7873	0.8481	0.7693
0.0358	0.232	2320	1.2247	0.8495	0.7794	0.8518	0.7588
0.0127	0.234	2340	1.3406	0.8423	0.7771	0.8482	0.7533
0.0596	0.236	2360	1.2308	0.8595	0.7904	0.8556	0.7775
0.0082	0.238	2380	1.3719	0.8450	0.7726	0.8561	0.7540
0.0194	0.24	2400	1.4780	0.8297	0.7618	0.8455	0.7357
0.0341	0.242	2420	1.4085	0.8386	0.7714	0.8508	0.7467
0.05	0.244	2440	1.7963	0.7845	0.6948	0.8236	0.6685
0.0274	0.246	2460	1.6832	0.8084	0.7257	0.8316	0.7001
0.0203	0.248	2480	1.6954	0.8184	0.7367	0.8438	0.7122
0.0328	0.25	2500	1.5345	0.8337	0.7524	0.8511	0.7314
0.0434	0.252	2520	1.5739	0.8045	0.7503	0.8236	0.7185
0.0505	0.254	2540	1.6393	0.8078	0.7450	0.8320	0.7139
0.0029	0.256	2560	1.4990	0.8317	0.7679	0.8484	0.7410
0.0437	0.258	2580	1.8746	0.7998	0.7167	0.8463	0.6877
0.0573	0.26	2600	2.2431	0.7610	0.6543	0.8298	0.6302
0.0313	0.262	2620	1.7306	0.8039	0.7137	0.8381	0.6910
0.0186	0.264	2640	1.7413	0.8062	0.7239	0.8425	0.6985
0.0426	0.266	2660	1.3704	0.8497	0.7810	0.8566	0.7600
0.0288	0.268	2680	1.2915	0.8531	0.7850	0.8523	0.7679
0.0402	0.27	2700	1.4792	0.8407	0.7610	0.8618	0.7405
0.0184	0.272	2720	1.6357	0.8331	0.7526	0.8616	0.7290
0.0162	0.274	2740	1.4176	0.8548	0.7797	0.8571	0.7663
0.0153	0.276	2760	1.3665	0.8556	0.7879	0.8540	0.7702
0.0189	0.278	2780	1.3686	0.8529	0.7857	0.8597	0.7650
0.0223	0.28	2800	1.3679	0.8566	0.7877	0.8650	0.7683
0.0193	0.282	2820	1.4252	0.8517	0.7814	0.8621	0.7632
0.0201	0.284	2840	1.5652	0.8266	0.7554	0.8548	0.7317
0.0102	0.286	2860	1.4620	0.8423	0.7787	0.8612	0.7562
0.0294	0.288	2880	1.6310	0.8143	0.7560	0.8416	0.7238
0.0106	0.29	2900	1.5361	0.8511	0.7813	0.8697	0.7623
0.0107	0.292	2920	1.6966	0.8211	0.7633	0.8530	0.7328
0.0063	0.294	2940	1.4493	0.8556	0.7930	0.8637	0.7727
0.0389	0.296	2960	1.3437	0.8617	0.7988	0.8552	0.7849
0.0274	0.298	2980	1.5037	0.8382	0.7787	0.8541	0.7543
0.0392	0.3	3000	1.3455	0.8482	0.7906	0.8556	0.7687
0.0367	0.302	3020	1.4267	0.8378	0.7752	0.8568	0.7504
0.0228	0.304	3040	1.3723	0.8587	0.7934	0.8671	0.7739
0.0259	0.306	3060	1.4159	0.8423	0.7802	0.8599	0.7568
0.0074	0.308	3080	1.6634	0.8217	0.7550	0.8538	0.7295
0.0386	0.31	3100	1.4854	0.8399	0.7712	0.8604	0.7476
0.017	0.312	3120	1.5554	0.8276	0.7633	0.8519	0.7362
0.0144	0.314	3140	1.4663	0.8354	0.7713	0.8500	0.7466
0.0142	0.316	3160	1.6349	0.8209	0.7528	0.8541	0.7230
0.0236	0.318	3180	1.6757	0.8180	0.7447	0.8566	0.7162
0.0712	0.32	3200	1.3367	0.8456	0.7829	0.8500	0.7603
0.0372	0.322	3220	1.3016	0.8619	0.7992	0.8657	0.7797
0.0301	0.324	3240	1.5439	0.8403	0.7657	0.8642	0.7417
0.0043	0.326	3260	1.3523	0.8495	0.7870	0.8371	0.7715
0.0112	0.328	3280	1.6203	0.8180	0.7489	0.8458	0.7202
0.0389	0.33	3300	1.6012	0.8276	0.7515	0.8558	0.7253
0.032	0.332	3320	1.4622	0.8511	0.7749	0.8709	0.7551
0.0484	0.334	3340	1.3753	0.8521	0.7822	0.8517	0.7646
0.0485	0.336	3360	1.3727	0.8507	0.7821	0.8510	0.7622
0.0412	0.338	3380	1.4621	0.8417	0.7700	0.8513	0.7480
0.062	0.34	3400	1.3283	0.8472	0.7808	0.8462	0.7593
0.0155	0.342	3420	1.4947	0.8284	0.7573	0.8388	0.7321
0.0604	0.344	3440	1.2953	0.8495	0.7857	0.8497	0.7640
0.0139	0.346	3460	1.3644	0.8562	0.7855	0.8667	0.7669
0.0115	0.348	3480	1.3503	0.8497	0.7849	0.8578	0.7627
0.0262	0.35	3500	1.4776	0.8388	0.7647	0.8649	0.7400
0.0197	0.352	3520	1.3169	0.8566	0.7911	0.8594	0.7704
0.0753	0.354	3540	1.4336	0.8466	0.7742	0.8650	0.7514
0.0541	0.356	3560	1.3846	0.8360	0.7752	0.8395	0.7506
0.0154	0.358	3580	1.1941	0.8601	0.8115	0.8347	0.7996
0.0015	0.36	3600	1.3277	0.8580	0.7972	0.8637	0.7755
0.0284	0.362	3620	1.4280	0.8523	0.7832	0.8693	0.7606
0.0237	0.364	3640	1.5248	0.8337	0.7633	0.8565	0.7369
0.0243	0.366	3660	1.5584	0.8386	0.7636	0.8640	0.7390
0.0628	0.368	3680	1.3950	0.8542	0.7860	0.8656	0.7646
0.0462	0.37	3700	1.4476	0.8419	0.7730	0.8574	0.7478
0.0128	0.372	3720	1.5086	0.8409	0.7705	0.8594	0.7455
0.013	0.374	3740	1.3820	0.8544	0.7885	0.8641	0.7663
0.0022	0.376	3760	1.3281	0.8601	0.7924	0.8650	0.7743
0.0359	0.378	3780	1.3168	0.8585	0.7955	0.8597	0.7758
0.004	0.38	3800	1.3508	0.8538	0.7900	0.8580	0.7686
0.0227	0.382	3820	1.3766	0.8542	0.7886	0.8630	0.7670
0.0409	0.384	3840	1.3383	0.8497	0.7855	0.8630	0.7620
0.0314	0.386	3860	1.3714	0.8493	0.7808	0.8648	0.7582
0.022	0.388	3880	1.3467	0.8531	0.7855	0.8590	0.7654
0.0039	0.39	3900	1.4044	0.8548	0.7884	0.8634	0.7676
0.0342	0.392	3920	1.3077	0.8572	0.7952	0.8527	0.7764
0.0258	0.394	3940	1.2968	0.8658	0.8013	0.8601	0.7873
0.0332	0.396	3960	1.3438	0.8540	0.7817	0.8615	0.7642
0.0153	0.398	3980	1.6289	0.8246	0.7433	0.8564	0.7179
0.0116	0.4	4000	1.4183	0.8454	0.7786	0.8485	0.7572
0.0349	0.402	4020	1.4774	0.8487	0.7767	0.8617	0.7561
0.02	0.404	4040	1.4637	0.8511	0.7788	0.8648	0.7587
0.0072	0.406	4060	1.5426	0.8352	0.7633	0.8539	0.7386
0.0229	0.408	4080	1.4962	0.8501	0.7801	0.8667	0.7580
0.0412	0.41	4100	1.2846	0.8632	0.8023	0.8580	0.7859
0.0227	0.412	4120	1.2946	0.8629	0.7982	0.8639	0.7815
0.0278	0.414	4140	1.3961	0.8493	0.7809	0.8610	0.7586
0.0171	0.416	4160	1.4801	0.8417	0.7674	0.8629	0.7441
0.0136	0.418	4180	1.4238	0.8507	0.7736	0.8680	0.7552
0.0213	0.42	4200	1.3588	0.8558	0.7873	0.8645	0.7667
0.029	0.422	4220	1.4318	0.8501	0.7789	0.8642	0.7571
0.0226	0.424	4240	1.3959	0.8542	0.7857	0.8660	0.7639
0.0049	0.426	4260	1.3321	0.8601	0.7949	0.8616	0.7757
0.0476	0.428	4280	1.3586	0.8568	0.7859	0.8644	0.7672
0.0462	0.43	4300	1.5131	0.8417	0.7649	0.8663	0.7416
0.0512	0.432	4320	1.2899	0.8505	0.7867	0.8500	0.7650
0.0285	0.434	4340	1.2635	0.8542	0.7881	0.8571	0.7685
0.0415	0.436	4360	1.2625	0.8511	0.7886	0.8552	0.7659
0.0482	0.438	4380	1.2407	0.8527	0.7846	0.8594	0.7646
0.0363	0.44	4400	1.3564	0.8384	0.7648	0.8620	0.7403
0.0276	0.442	4420	1.1727	0.8576	0.7985	0.8458	0.7820
0.0039	0.444	4440	1.2807	0.8619	0.7984	0.8675	0.7790
0.0262	0.446	4460	1.3800	0.8523	0.7815	0.8681	0.7607
0.039	0.448	4480	1.4388	0.8421	0.7736	0.8638	0.7475
0.0223	0.45	4500	1.1979	0.8660	0.8041	0.8597	0.7897
0.0073	0.452	4520	1.2264	0.8576	0.7999	0.8458	0.7820
0.0269	0.454	4540	1.2685	0.8603	0.8002	0.8567	0.7808
0.0131	0.456	4560	1.3904	0.8505	0.7824	0.8669	0.7587
0.01	0.458	4580	1.4277	0.8499	0.7804	0.8669	0.7572
0.0236	0.46	4600	1.3922	0.8476	0.7863	0.8531	0.7627
0.0216	0.462	4620	1.3886	0.8499	0.7872	0.8588	0.7631
0.0138	0.464	4640	1.4872	0.8462	0.7754	0.8697	0.7510
0.0522	0.466	4660	1.4304	0.8446	0.7710	0.8642	0.7486
0.0071	0.468	4680	1.3784	0.8517	0.7807	0.8637	0.7601
0.0426	0.47	4700	1.3193	0.8544	0.7903	0.8554	0.7698
0.0436	0.472	4720	1.2188	0.8609	0.8004	0.8553	0.7821
0.013	0.474	4740	1.4031	0.8474	0.7763	0.8669	0.7532
0.0443	0.476	4760	1.5753	0.8192	0.7395	0.8551	0.7140
0.0444	0.478	4780	1.3850	0.8429	0.7643	0.8643	0.7438
0.0002	0.48	4800	1.4815	0.8358	0.7535	0.8639	0.7319
0.0089	0.482	4820	1.4944	0.8250	0.7524	0.8528	0.7242
0.0239	0.484	4840	1.3902	0.8370	0.7726	0.8432	0.7478
0.0333	0.486	4860	1.4922	0.8211	0.7561	0.8364	0.7272
0.0271	0.488	4880	1.5084	0.8276	0.7577	0.8503	0.7295
0.0337	0.49	4900	1.3764	0.8440	0.7774	0.8570	0.7526
0.0602	0.492	4920	1.3659	0.8393	0.7638	0.8585	0.7410
0.0212	0.494	4940	1.2901	0.8501	0.7837	0.8587	0.7624
0.014	0.496	4960	1.3822	0.8354	0.7668	0.8564	0.7402
0.0012	0.498	4980	1.4594	0.8305	0.7592	0.8557	0.7319
0.0051	0.5	5000	1.5347	0.8248	0.7521	0.8560	0.7230
0.0223	0.502	5020	1.4165	0.8370	0.7671	0.8594	0.7404
0.0053	0.504	5040	1.3180	0.8525	0.7900	0.8651	0.7651
0.0293	0.506	5060	1.2316	0.8595	0.7992	0.8675	0.7778
0.0391	0.508	5080	1.3382	0.8415	0.7784	0.8600	0.7524
0.0134	0.51	5100	1.3917	0.8474	0.7773	0.8643	0.7549
0.0187	0.512	5120	1.3604	0.8435	0.7802	0.8625	0.7568
0.027	0.514	5140	1.5380	0.8217	0.7518	0.8541	0.7250
0.0367	0.516	5160	1.4179	0.8241	0.7553	0.8585	0.7283
0.0163	0.518	5180	1.3710	0.8331	0.7660	0.8605	0.7386
0.0241	0.52	5200	1.2647	0.8450	0.7845	0.8507	0.7595
0.0122	0.522	5220	1.3431	0.8493	0.7843	0.8646	0.7594
0.0405	0.524	5240	1.4083	0.8405	0.7718	0.8631	0.7454
0.0315	0.526	5260	1.2555	0.8617	0.7963	0.8706	0.7773
0.0158	0.528	5280	1.4175	0.8274	0.7667	0.8562	0.7390
0.0242	0.53	5300	1.2810	0.8476	0.7901	0.8563	0.7665
0.0161	0.532	5320	1.3278	0.8544	0.7883	0.8677	0.7666
0.0353	0.534	5340	1.2567	0.8658	0.8044	0.8681	0.7858
0.0062	0.536	5360	1.3290	0.8589	0.7932	0.8681	0.7724
0.0184	0.538	5380	1.2692	0.8560	0.7939	0.8565	0.7744
0.059	0.54	5400	1.2367	0.8605	0.8013	0.8580	0.7814
0.0206	0.542	5420	1.3156	0.8552	0.7912	0.8618	0.7703
0.0175	0.544	5440	1.5553	0.8199	0.7552	0.8570	0.7240
0.0415	0.546	5460	1.3599	0.8546	0.7854	0.8685	0.7650
0.0432	0.548	5480	1.5341	0.8201	0.7529	0.8536	0.7219
0.0545	0.55	5500	1.5413	0.8090	0.7443	0.8475	0.7110
0.0234	0.552	5520	1.6712	0.8009	0.7334	0.8505	0.6984
0.0156	0.554	5540	1.6123	0.8213	0.7497	0.8586	0.7196
0.0172	0.556	5560	1.6196	0.8201	0.7493	0.8646	0.7179
0.029	0.558	5580	1.5016	0.8301	0.7614	0.8682	0.7327
0.0216	0.56	5600	1.4448	0.8466	0.7809	0.8622	0.7560
0.0641	0.562	5620	1.5083	0.8358	0.7627	0.8672	0.7364
0.0244	0.564	5640	1.4582	0.8393	0.7712	0.8654	0.7443
0.0304	0.566	5660	1.4796	0.8372	0.7669	0.8686	0.7401
0.0299	0.568	5680	1.4776	0.8442	0.7725	0.8713	0.7481
0.0108	0.57	5700	1.5837	0.8311	0.7575	0.8679	0.7291
0.0568	0.572	5720	1.2901	0.8527	0.7926	0.8573	0.7697
0.0012	0.574	5740	1.3570	0.8509	0.7904	0.8624	0.7658
0.0161	0.576	5760	1.4200	0.8407	0.7803	0.8596	0.7541
0.045	0.578	5780	1.4508	0.8440	0.7796	0.8656	0.7532
0.04	0.58	5800	1.4328	0.8382	0.7785	0.8620	0.7500
0.054	0.582	5820	1.2936	0.8478	0.7885	0.8600	0.7628
0.0366	0.584	5840	1.3365	0.8431	0.7793	0.8626	0.7525
0.0325	0.586	5860	1.2088	0.8542	0.7973	0.8567	0.7739
0.0155	0.588	5880	1.2584	0.8554	0.7917	0.8624	0.7695
0.0027	0.59	5900	1.2414	0.8546	0.7967	0.8527	0.7747
0.0203	0.592	5920	1.4011	0.8403	0.7738	0.8618	0.7468
0.0047	0.594	5940	1.3959	0.8409	0.7760	0.8623	0.7486
0.0156	0.596	5960	1.5100	0.8284	0.7621	0.8619	0.7316
0.0315	0.598	5980	1.5174	0.8254	0.7555	0.8604	0.7283
0.0421	0.6	6000	1.3203	0.8585	0.7901	0.8684	0.7714
0.0009	0.602	6020	1.3933	0.8533	0.7813	0.8694	0.7616
0.0159	0.604	6040	1.3371	0.8617	0.7926	0.8695	0.7761
0.0126	0.606	6060	1.3021	0.8593	0.7941	0.8599	0.7762
0.0456	0.608	6080	1.4119	0.8468	0.7778	0.8623	0.7544
0.0231	0.61	6100	1.4231	0.8464	0.7747	0.8642	0.7528
0.0257	0.612	6120	1.5582	0.8295	0.7535	0.8673	0.7269
0.024	0.614	6140	1.4474	0.8399	0.7677	0.8629	0.7426
0.0271	0.616	6160	1.3643	0.8527	0.7831	0.8686	0.7618
0.004	0.618	6180	1.4824	0.8319	0.7618	0.8647	0.7349
0.0157	0.62	6200	1.6797	0.8045	0.7176	0.8557	0.6934
0.0084	0.622	6220	1.4220	0.8305	0.7666	0.8526	0.7400
0.0273	0.624	6240	1.3800	0.8274	0.7721	0.8473	0.7436
0.0363	0.626	6260	1.3942	0.8254	0.7647	0.8512	0.7365
0.0471	0.628	6280	1.2489	0.8480	0.7869	0.8557	0.7650
0.0134	0.63	6300	1.2962	0.8489	0.7854	0.8544	0.7623
0.0019	0.632	6320	1.3361	0.8480	0.7848	0.8596	0.7603
0.0145	0.634	6340	1.2290	0.8607	0.8010	0.8548	0.7819
0.0328	0.636	6360	1.3161	0.8466	0.7822	0.8577	0.7587
0.013	0.638	6380	1.4434	0.8278	0.7626	0.8548	0.7338
0.0157	0.64	6400	1.5072	0.8305	0.7608	0.8614	0.7326
0.0162	0.642	6420	1.4384	0.8372	0.7676	0.8619	0.7421
0.0031	0.644	6440	1.4686	0.8354	0.7641	0.8624	0.7384
0.0168	0.646	6460	1.6082	0.8233	0.7480	0.8610	0.7198
0.0096	0.648	6480	1.5840	0.8256	0.7523	0.8606	0.7238
0.0254	0.65	6500	1.4263	0.8403	0.7747	0.8617	0.7482
0.0284	0.652	6520	1.3740	0.8468	0.7820	0.8659	0.7573
0.0127	0.654	6540	1.3811	0.8368	0.7746	0.8558	0.7473
0.0313	0.656	6560	1.3887	0.8346	0.7719	0.8502	0.7447
0.0308	0.658	6580	1.3531	0.8376	0.7771	0.8455	0.7510
0.0121	0.66	6600	1.3415	0.8409	0.7791	0.8491	0.7540
0.0337	0.662	6620	1.3951	0.8319	0.7632	0.8505	0.7375
0.0153	0.664	6640	1.4965	0.8219	0.7512	0.8556	0.7234
0.0169	0.666	6660	1.3800	0.8409	0.7719	0.8565	0.7478
0.0231	0.668	6680	1.6212	0.8170	0.7375	0.8563	0.7097
0.0229	0.67	6700	1.4507	0.8268	0.7616	0.8461	0.7330
0.0083	0.672	6720	1.4151	0.8325	0.7666	0.8452	0.7400
0.0122	0.674	6740	1.3248	0.8509	0.7871	0.8619	0.7637
0.0028	0.676	6760	1.4581	0.8372	0.7668	0.8620	0.7406
0.0196	0.678	6780	1.3441	0.8542	0.7842	0.8699	0.7633
0.0564	0.68	6800	1.2805	0.8517	0.7818	0.8627	0.7629
0.0426	0.682	6820	1.2163	0.8542	0.7889	0.8582	0.7699
0.012	0.684	6840	1.2336	0.8407	0.7798	0.8520	0.7572
0.0053	0.686	6860	1.3346	0.8282	0.7663	0.8526	0.7394
0.018	0.688	6880	1.2456	0.8368	0.7803	0.8446	0.7564
0.0284	0.69	6900	1.3215	0.8295	0.7674	0.8489	0.7398
0.0206	0.692	6920	1.2697	0.8366	0.7774	0.8452	0.7518
0.0185	0.694	6940	1.2302	0.8507	0.7889	0.8528	0.7671
0.0074	0.696	6960	1.2804	0.8466	0.7836	0.8548	0.7601
0.0211	0.698	6980	1.3472	0.8425	0.7749	0.8618	0.7509
0.0093	0.7	7000	1.3526	0.8478	0.7780	0.8635	0.7564
0.0229	0.702	7020	1.3637	0.8505	0.7800	0.8662	0.7586
0.047	0.704	7040	1.4245	0.8384	0.7701	0.8589	0.7444
0.02	0.706	7060	1.4446	0.8393	0.7677	0.8610	0.7433
0.0322	0.708	7080	1.3445	0.8454	0.7807	0.8566	0.7568
0.0166	0.71	7100	1.3218	0.8452	0.7810	0.8545	0.7573
0.0154	0.712	7120	1.3052	0.8468	0.7852	0.8529	0.7615
0.0209	0.714	7140	1.3200	0.8419	0.7788	0.8499	0.7541
0.0123	0.716	7160	1.3558	0.8393	0.7735	0.8509	0.7481
0.011	0.718	7180	1.3138	0.8470	0.7804	0.8543	0.7577
0.0333	0.72	7200	1.3000	0.8495	0.7839	0.8552	0.7616
0.0489	0.722	7220	1.2575	0.8484	0.7825	0.8537	0.7601
0.0394	0.724	7240	1.3221	0.8456	0.7768	0.8543	0.7540
0.0076	0.726	7260	1.4044	0.8399	0.7682	0.8604	0.7433
0.0209	0.728	7280	1.3183	0.8472	0.7808	0.8570	0.7574
0.0068	0.73	7300	1.2884	0.8505	0.7843	0.8573	0.7619
0.035	0.732	7320	1.3119	0.8501	0.7820	0.8564	0.7602
0.0146	0.734	7340	1.3595	0.8482	0.7770	0.8614	0.7546
0.0175	0.736	7360	1.3735	0.8429	0.7740	0.8563	0.7496
0.0197	0.738	7380	1.2753	0.8554	0.7917	0.8559	0.7709
0.0145	0.74	7400	1.3514	0.8470	0.7807	0.8574	0.7569
0.0471	0.742	7420	1.3011	0.8507	0.7850	0.8622	0.7613
0.0384	0.744	7440	1.2594	0.8515	0.7891	0.8590	0.7654
0.004	0.746	7460	1.2978	0.8466	0.7797	0.8559	0.7565
0.0357	0.748	7480	1.2685	0.8507	0.7826	0.8573	0.7615
0.0072	0.75	7500	1.3033	0.8468	0.7770	0.8569	0.7548
0.0148	0.752	7520	1.2454	0.8558	0.7917	0.8603	0.7704
0.0187	0.754	7540	1.2755	0.8574	0.7884	0.8615	0.7697
0.0362	0.756	7560	1.3040	0.8538	0.7855	0.8632	0.7647
0.0168	0.758	7580	1.2815	0.8550	0.7888	0.8611	0.7679
0.0319	0.76	7600	1.2986	0.8527	0.7856	0.8587	0.7647
0.0118	0.762	7620	1.3524	0.8478	0.7798	0.8593	0.7567
0.0171	0.764	7640	1.3086	0.8531	0.7870	0.8583	0.7655
0.0192	0.766	7660	1.3387	0.8515	0.7818	0.8610	0.7607
0.0146	0.768	7680	1.4237	0.8442	0.7715	0.8606	0.7486
0.0257	0.77	7700	1.4340	0.8413	0.7698	0.8586	0.7454
0.0427	0.772	7720	1.4500	0.8393	0.7673	0.8578	0.7424
0.0001	0.774	7740	1.4393	0.8421	0.7709	0.8590	0.7463
0.0056	0.776	7760	1.4137	0.8444	0.7749	0.8586	0.7508
0.0054	0.778	7780	1.4455	0.8415	0.7703	0.8583	0.7459
0.0224	0.78	7800	1.3827	0.8470	0.7786	0.8570	0.7555
0.0002	0.782	7820	1.3901	0.8454	0.7762	0.8566	0.7533
0.01	0.784	7840	1.3898	0.8454	0.7779	0.8594	0.7541
0.0115	0.786	7860	1.3709	0.8521	0.7823	0.8623	0.7611
0.0207	0.788	7880	1.3256	0.8542	0.7868	0.8588	0.7665
0.0254	0.79	7900	1.2879	0.8572	0.7928	0.8582	0.7731
0.0284	0.792	7920	1.2851	0.8570	0.7933	0.8601	0.7721
0.0056	0.794	7940	1.3286	0.8533	0.7891	0.8613	0.7659
0.004	0.796	7960	1.3264	0.8560	0.7923	0.8604	0.7703
0.0304	0.798	7980	1.3460	0.8546	0.7896	0.8629	0.7667
0.0074	0.8	8000	1.3500	0.8546	0.7896	0.8616	0.7671
0.0123	0.802	8020	1.3229	0.8578	0.7943	0.8636	0.7725
0.034	0.804	8040	1.3199	0.8593	0.7953	0.8648	0.7742
0.0103	0.806	8060	1.3439	0.8548	0.7913	0.8603	0.7686
0.0001	0.808	8080	1.3214	0.8593	0.7964	0.8640	0.7748
0.0019	0.81	8100	1.3628	0.8544	0.7908	0.8608	0.7677
0.0018	0.812	8120	1.3703	0.8538	0.7911	0.8596	0.7677
0.0006	0.814	8140	1.3588	0.8564	0.7942	0.8617	0.7713
0.0004	0.816	8160	1.3652	0.8540	0.7942	0.8579	0.7706
0.0421	0.818	8180	1.4159	0.8468	0.7828	0.8570	0.7580
0.0379	0.82	8200	1.3623	0.8507	0.7916	0.8562	0.7669
0.0016	0.822	8220	1.3659	0.8531	0.7914	0.8604	0.7676
0.0186	0.824	8240	1.3941	0.8456	0.7832	0.8560	0.7576
0.0295	0.826	8260	1.3841	0.8466	0.7845	0.8555	0.7594
0.0264	0.828	8280	1.3704	0.8484	0.7867	0.8574	0.7619
0.0171	0.83	8300	1.3531	0.8503	0.7912	0.8570	0.7663
0.017	0.832	8320	1.4407	0.8429	0.7773	0.8579	0.7516
0.0316	0.834	8340	1.4321	0.8393	0.7737	0.8530	0.7473
0.023	0.836	8360	1.4401	0.8401	0.7722	0.8585	0.7461
0.0063	0.838	8380	1.4163	0.8423	0.7758	0.8588	0.7500
0.0024	0.84	8400	1.4562	0.8399	0.7722	0.8580	0.7459
0.0037	0.842	8420	1.4190	0.8446	0.7775	0.8587	0.7526
0.0262	0.844	8440	1.4119	0.8450	0.7791	0.8607	0.7534
0.006	0.846	8460	1.3936	0.8476	0.7816	0.8611	0.7570
0.0354	0.848	8480	1.3733	0.8474	0.7832	0.8580	0.7586
0.0137	0.85	8500	1.3665	0.8480	0.7851	0.8587	0.7601
0.0243	0.852	8520	1.3896	0.8450	0.7785	0.8599	0.7533
0.0235	0.854	8540	1.3908	0.8460	0.7787	0.8609	0.7540
0.0114	0.856	8560	1.3842	0.8448	0.7777	0.8595	0.7527
0.0126	0.858	8580	1.3689	0.8446	0.7798	0.8563	0.7547
0.0186	0.86	8600	1.2981	0.8513	0.7887	0.8545	0.7660
0.0158	0.862	8620	1.2734	0.8525	0.7930	0.8530	0.7704
0.0028	0.864	8640	1.2963	0.8531	0.7914	0.8560	0.7687
0.0005	0.866	8660	1.3336	0.8503	0.7853	0.8560	0.7624
0.0183	0.868	8680	1.3398	0.8509	0.7840	0.8597	0.7613
0.0095	0.87	8700	1.3530	0.8503	0.7835	0.8611	0.7603
0.0047	0.872	8720	1.3765	0.8480	0.7810	0.8608	0.7570
0.0233	0.874	8740	1.4427	0.8433	0.7738	0.8614	0.7487
0.0026	0.876	8760	1.4369	0.8435	0.7747	0.8612	0.7497
0.0177	0.878	8780	1.4600	0.8403	0.7727	0.8590	0.7463
0.0046	0.88	8800	1.4419	0.8421	0.7749	0.8593	0.7490
0.0111	0.882	8820	1.4529	0.8429	0.7744	0.8616	0.7487
0.0158	0.884	8840	1.4249	0.8452	0.7766	0.8602	0.7520
0.0356	0.886	8860	1.3788	0.8484	0.7821	0.8603	0.7579
0.0356	0.888	8880	1.3773	0.8493	0.7840	0.8627	0.7593
0.058	0.89	8900	1.3693	0.8472	0.7829	0.8592	0.7578
0.0227	0.892	8920	1.3804	0.8440	0.7773	0.8561	0.7524
0.0372	0.894	8940	1.3698	0.8474	0.7805	0.8592	0.7564
0.0377	0.896	8960	1.3557	0.8487	0.7825	0.8586	0.7589
0.0297	0.898	8980	1.3414	0.8505	0.7864	0.8599	0.7625
0.01	0.9	9000	1.3348	0.8525	0.7883	0.8606	0.7652
0.0309	0.902	9020	1.3000	0.8542	0.7909	0.8609	0.7683
0.0346	0.904	9040	1.2752	0.8576	0.7956	0.8636	0.7735
0.0143	0.906	9060	1.2954	0.8568	0.7938	0.8635	0.7717
0.0187	0.908	9080	1.3109	0.8542	0.7908	0.8621	0.7680
0.0002	0.91	9100	1.3237	0.8542	0.7908	0.8629	0.7677
0.0099	0.912	9120	1.3458	0.8515	0.7875	0.8602	0.7640
0.0128	0.914	9140	1.3486	0.8513	0.7866	0.8609	0.7631
0.0574	0.916	9160	1.3279	0.8527	0.7893	0.8601	0.7658
0.0121	0.918	9180	1.3496	0.8495	0.7853	0.8585	0.7611
0.0179	0.92	9200	1.3531	0.8503	0.7860	0.8595	0.7619
0.0095	0.922	9220	1.3512	0.8517	0.7872	0.8612	0.7635
0.0181	0.924	9240	1.3376	0.8519	0.7881	0.8581	0.7649
0.014	0.926	9260	1.3395	0.8531	0.7891	0.8623	0.7657
0.0238	0.928	9280	1.3482	0.8513	0.7875	0.8584	0.7640
0.0002	0.93	9300	1.3507	0.8511	0.7870	0.8591	0.7634
0.0058	0.932	9320	1.3615	0.8503	0.7861	0.8616	0.7619
0.0122	0.934	9340	1.3691	0.8495	0.7857	0.8623	0.7609
0.0047	0.936	9360	1.3662	0.8480	0.7841	0.8574	0.7597
0.0128	0.938	9380	1.3775	0.8464	0.7816	0.8576	0.7567
0.0156	0.94	9400	1.3955	0.8464	0.7809	0.8595	0.7559
0.022	0.942	9420	1.4096	0.8458	0.7792	0.8611	0.7540
0.0035	0.944	9440	1.4199	0.8454	0.7784	0.8614	0.7532
0.0008	0.946	9460	1.4331	0.8446	0.7762	0.8608	0.7513
0.005	0.948	9480	1.4374	0.8431	0.7742	0.8598	0.7491
0.0576	0.95	9500	1.4237	0.8454	0.7784	0.8613	0.7532
0.0374	0.952	9520	1.4038	0.8466	0.7798	0.8606	0.7550
0.0001	0.954	9540	1.3973	0.8472	0.7808	0.8604	0.7561
0.0036	0.956	9560	1.3831	0.8491	0.7841	0.8606	0.7596
0.0073	0.958	9580	1.3784	0.8491	0.7841	0.8595	0.7598
0.0415	0.96	9600	1.3735	0.8501	0.7851	0.8618	0.7609
0.0016	0.962	9620	1.3675	0.8511	0.7859	0.8630	0.7621
0.0166	0.964	9640	1.3566	0.8523	0.7874	0.8628	0.7641
0.0103	0.966	9660	1.3614	0.8515	0.7863	0.8627	0.7628
0.0067	0.968	9680	1.3839	0.8507	0.7846	0.8638	0.7605
0.0017	0.97	9700	1.3957	0.8491	0.7826	0.8629	0.7582
0.0346	0.972	9720	1.3773	0.8507	0.7846	0.8636	0.7607
0.0033	0.974	9740	1.3816	0.8503	0.7842	0.8637	0.7600
0.0265	0.976	9760	1.3870	0.8493	0.7827	0.8630	0.7584
0.0355	0.978	9780	1.3858	0.8489	0.7824	0.8619	0.7582
0.0001	0.98	9800	1.3875	0.8491	0.7826	0.8624	0.7585
0.0356	0.982	9820	1.3823	0.8495	0.7839	0.8620	0.7596
0.0039	0.984	9840	1.3777	0.8503	0.7855	0.8626	0.7612
0.0074	0.986	9860	1.3826	0.8497	0.7843	0.8626	0.7598
0.0094	0.988	9880	1.3823	0.8493	0.7834	0.8621	0.7591
0.0014	0.99	9900	1.3820	0.8499	0.7845	0.8627	0.7601
0.0488	0.992	9920	1.3875	0.8487	0.7832	0.8623	0.7584
0.0144	0.994	9940	1.3880	0.8487	0.7830	0.8621	0.7583
0.0378	0.996	9960	1.3852	0.8489	0.7831	0.8619	0.7586
0.0234	0.998	9980	1.3850	0.8491	0.7835	0.8621	0.7590
0.0124	1.0	10000	1.3854	0.8487	0.7828	0.8618	0.7583

Framework versions

• Transformers 4.43.3
• Pytorch 2.4.0
• Datasets 2.20.0
• Tokenizers 0.19.1