--- library_name: transformers license: mit base_model: karline/tts_me_realCS_dataset tags: - generated_from_trainer datasets: - audiofolder model-index: - name: tts_me_realCS_dataset results: [] --- # tts_me_realCS_dataset This model is a fine-tuned version of [karline/tts_me_realCS_dataset](https://huggingface.co/karline/tts_me_realCS_dataset) on the audiofolder dataset. It achieves the following results on the evaluation set: - Loss: 0.4252 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 4 - eval_batch_size: 2 - seed: 42 - gradient_accumulation_steps: 8 - total_train_batch_size: 32 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 100 - training_steps: 40000 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | |:-------------:|:-------:|:-----:|:---------------:| | 0.5661 | 0.1808 | 100 | 0.5027 | | 0.5194 | 0.3616 | 200 | 0.4732 | | 0.4983 | 0.5424 | 300 | 0.4571 | | 0.4966 | 0.7232 | 400 | 0.4554 | | 0.4867 | 0.9040 | 500 | 0.4494 | | 0.4808 | 1.0832 | 600 | 0.4493 | | 0.4806 | 1.2640 | 700 | 0.4455 | | 0.4763 | 1.4447 | 800 | 0.4439 | | 0.4733 | 1.6255 | 900 | 0.4427 | | 0.4756 | 1.8063 | 1000 | 0.4377 | | 0.4689 | 1.9871 | 1100 | 0.4357 | | 0.4658 | 2.1663 | 1200 | 0.4343 | | 0.4637 | 2.3471 | 1300 | 0.4342 | | 0.462 | 2.5279 | 1400 | 0.4299 | | 0.4621 | 2.7087 | 1500 | 0.4258 | | 0.4571 | 2.8895 | 1600 | 0.4234 | | 0.4539 | 3.0687 | 1700 | 0.4214 | | 0.4485 | 3.2495 | 1800 | 0.4184 | | 0.4502 | 3.4303 | 1900 | 0.4173 | | 0.4493 | 3.6111 | 2000 | 0.4160 | | 0.4459 | 3.7919 | 2100 | 0.4156 | | 0.444 | 3.9727 | 2200 | 0.4144 | | 0.4405 | 4.1519 | 2300 | 0.4129 | | 0.4411 | 4.3327 | 2400 | 0.4141 | | 0.4403 | 4.5134 | 2500 | 0.4120 | | 0.4411 | 4.6942 | 2600 | 0.4118 | | 0.4396 | 4.8750 | 2700 | 0.4091 | | 0.4345 | 5.0542 | 2800 | 0.4085 | | 0.4348 | 5.2350 | 2900 | 0.4089 | | 0.4363 | 5.4158 | 3000 | 0.4088 | | 0.4325 | 5.5966 | 3100 | 0.4088 | | 0.4325 | 5.7774 | 3200 | 0.4081 | | 0.4345 | 5.9582 | 3300 | 0.4080 | | 0.4332 | 6.1374 | 3400 | 0.4076 | | 0.4321 | 6.3182 | 3500 | 0.4067 | | 0.4273 | 6.4990 | 3600 | 0.4071 | | 0.4309 | 6.6798 | 3700 | 0.4079 | | 0.432 | 6.8606 | 3800 | 0.4057 | | 0.4145 | 7.0398 | 3900 | 0.4057 | | 0.4277 | 7.2206 | 4000 | 0.4053 | | 0.4275 | 7.4014 | 4100 | 0.4045 | | 0.4307 | 7.5821 | 4200 | 0.4054 | | 0.4252 | 7.7629 | 4300 | 0.4044 | | 0.4306 | 7.9437 | 4400 | 0.4048 | | 0.4257 | 8.1229 | 4500 | 0.4042 | | 0.4332 | 8.3037 | 4600 | 0.4049 | | 0.4269 | 8.4845 | 4700 | 0.4041 | | 0.429 | 8.6653 | 4800 | 0.4033 | | 0.4245 | 8.8461 | 4900 | 0.4043 | | 0.4111 | 9.0253 | 5000 | 0.4043 | | 0.4304 | 9.2224 | 5100 | 0.4078 | | 0.4316 | 9.4032 | 5200 | 0.4080 | | 0.4304 | 9.5840 | 5300 | 0.4079 | | 0.431 | 9.7647 | 5400 | 0.4073 | | 0.4325 | 9.9455 | 5500 | 0.4059 | | 0.4293 | 10.1266 | 5600 | 0.4087 | | 0.4285 | 10.3073 | 5700 | 0.4089 | | 0.4279 | 10.4881 | 5800 | 0.4092 | | 0.4295 | 10.6689 | 5900 | 0.4074 | | 0.4319 | 10.8497 | 6000 | 0.4064 | | 0.4152 | 11.0289 | 6100 | 0.4053 | | 0.4209 | 11.2097 | 6200 | 0.4049 | | 0.4285 | 11.3905 | 6300 | 0.4052 | | 0.4258 | 11.5713 | 6400 | 0.4063 | | 0.4302 | 11.7521 | 6500 | 0.4055 | | 0.4274 | 11.9329 | 6600 | 0.4046 | | 0.42 | 12.1121 | 6700 | 0.4055 | | 0.4254 | 12.2929 | 6800 | 0.4042 | | 0.4234 | 12.4737 | 6900 | 0.4050 | | 0.4208 | 12.6545 | 7000 | 0.4064 | | 0.423 | 12.8353 | 7100 | 0.4032 | | 0.4093 | 13.0145 | 7200 | 0.4050 | | 0.4217 | 13.1953 | 7300 | 0.4070 | | 0.422 | 13.3760 | 7400 | 0.4053 | | 0.4198 | 13.5568 | 7500 | 0.4029 | | 0.421 | 13.7376 | 7600 | 0.4032 | | 0.4215 | 13.9184 | 7700 | 0.4052 | | 0.4176 | 14.0976 | 7800 | 0.4042 | | 0.4197 | 14.2784 | 7900 | 0.4040 | | 0.42 | 14.4592 | 8000 | 0.4059 | | 0.423 | 14.64 | 8100 | 0.4045 | | 0.418 | 14.8208 | 8200 | 0.4032 | | 0.4038 | 15.0 | 8300 | 0.4036 | | 0.4213 | 15.1808 | 8400 | 0.4049 | | 0.4175 | 15.3616 | 8500 | 0.4059 | | 0.4186 | 15.5424 | 8600 | 0.4051 | | 0.4181 | 15.7232 | 8700 | 0.4023 | | 0.4136 | 15.9040 | 8800 | 0.4037 | | 0.4165 | 16.0832 | 8900 | 0.4069 | | 0.4164 | 16.2640 | 9000 | 0.4044 | | 0.4158 | 16.4447 | 9100 | 0.4072 | | 0.4145 | 16.6255 | 9200 | 0.4040 | | 0.4158 | 16.8063 | 9300 | 0.4016 | | 0.4206 | 16.9871 | 9400 | 0.4113 | | 0.4135 | 17.1663 | 9500 | 0.4052 | | 0.4134 | 17.3471 | 9600 | 0.4049 | | 0.4145 | 17.5279 | 9700 | 0.4070 | | 0.4138 | 17.7087 | 9800 | 0.4056 | | 0.4152 | 17.8895 | 9900 | 0.4058 | | 0.4151 | 18.0687 | 10000 | 0.4057 | | 0.4135 | 18.2495 | 10100 | 0.4055 | | 0.4114 | 18.4303 | 10200 | 0.4062 | | 0.4111 | 18.6111 | 10300 | 0.4048 | | 0.4128 | 18.7919 | 10400 | 0.4058 | | 0.4092 | 18.9727 | 10500 | 0.4043 | | 0.4118 | 19.1519 | 10600 | 0.4064 | | 0.4131 | 19.3327 | 10700 | 0.4059 | | 0.4104 | 19.5134 | 10800 | 0.4044 | | 0.4157 | 19.6942 | 10900 | 0.4060 | | 0.4133 | 19.8750 | 11000 | 0.4051 | | 0.4109 | 20.0542 | 11100 | 0.4058 | | 0.4128 | 20.2350 | 11200 | 0.4043 | | 0.4101 | 20.4158 | 11300 | 0.4055 | | 0.4096 | 20.5966 | 11400 | 0.4043 | | 0.4101 | 20.7774 | 11500 | 0.4031 | | 0.4092 | 20.9582 | 11600 | 0.4062 | | 0.41 | 21.1374 | 11700 | 0.4052 | | 0.4101 | 21.3182 | 11800 | 0.4064 | | 0.407 | 21.4990 | 11900 | 0.4049 | | 0.4106 | 21.6798 | 12000 | 0.4068 | | 0.4077 | 21.8606 | 12100 | 0.4035 | | 0.3941 | 22.0398 | 12200 | 0.4071 | | 0.4087 | 22.2206 | 12300 | 0.4110 | | 0.4097 | 22.4014 | 12400 | 0.4045 | | 0.4096 | 22.5821 | 12500 | 0.4056 | | 0.4099 | 22.7629 | 12600 | 0.4052 | | 0.4064 | 22.9437 | 12700 | 0.4082 | | 0.4065 | 23.1229 | 12800 | 0.4071 | | 0.405 | 23.3037 | 12900 | 0.4071 | | 0.4069 | 23.4845 | 13000 | 0.4062 | | 0.405 | 23.6653 | 13100 | 0.4069 | | 0.4078 | 23.8461 | 13200 | 0.4057 | | 0.394 | 24.0253 | 13300 | 0.4079 | | 0.4063 | 24.2061 | 13400 | 0.4075 | | 0.4087 | 24.4122 | 13500 | 0.4092 | | 0.4094 | 24.5930 | 13600 | 0.4069 | | 0.4104 | 24.7738 | 13700 | 0.4066 | | 0.4076 | 24.9546 | 13800 | 0.4107 | | 0.4094 | 25.1356 | 13900 | 0.4087 | | 0.4061 | 25.3164 | 14000 | 0.4059 | | 0.4095 | 25.4972 | 14100 | 0.4082 | | 0.4069 | 25.6780 | 14200 | 0.4099 | | 0.4101 | 25.8588 | 14300 | 0.4076 | | 0.3903 | 26.0380 | 14400 | 0.4075 | | 0.4075 | 26.2188 | 14500 | 0.4102 | | 0.4091 | 26.3995 | 14600 | 0.4092 | | 0.4095 | 26.5803 | 14700 | 0.4070 | | 0.4065 | 26.7611 | 14800 | 0.4088 | | 0.4099 | 26.9419 | 14900 | 0.4088 | | 0.4072 | 27.1211 | 15000 | 0.4088 | | 0.404 | 27.3019 | 15100 | 0.4076 | | 0.4072 | 27.4827 | 15200 | 0.4088 | | 0.4058 | 27.6635 | 15300 | 0.4074 | | 0.4089 | 27.8443 | 15400 | 0.4084 | | 0.3922 | 28.0235 | 15500 | 0.4076 | | 0.4069 | 28.2043 | 15600 | 0.4118 | | 0.406 | 28.3851 | 15700 | 0.4077 | | 0.4039 | 28.5659 | 15800 | 0.4084 | | 0.4076 | 28.7467 | 15900 | 0.4056 | | 0.4057 | 28.9275 | 16000 | 0.4067 | | 0.4065 | 29.1067 | 16100 | 0.4081 | | 0.407 | 29.2875 | 16200 | 0.4092 | | 0.4061 | 29.4682 | 16300 | 0.4150 | | 0.4049 | 29.6490 | 16400 | 0.4074 | | 0.4057 | 29.8298 | 16500 | 0.4068 | | 0.3907 | 30.0090 | 16600 | 0.4106 | | 0.4069 | 30.1898 | 16700 | 0.4098 | | 0.399 | 30.3706 | 16800 | 0.4051 | | 0.4066 | 30.5514 | 16900 | 0.4100 | | 0.403 | 30.7322 | 17000 | 0.4073 | | 0.4052 | 30.9130 | 17100 | 0.4060 | | 0.4007 | 31.0922 | 17200 | 0.4074 | | 0.4053 | 31.2730 | 17300 | 0.4097 | | 0.4016 | 31.4538 | 17400 | 0.4130 | | 0.4034 | 31.6346 | 17500 | 0.4100 | | 0.3997 | 31.8154 | 17600 | 0.4098 | | 0.4054 | 31.9962 | 17700 | 0.4088 | | 0.403 | 32.1754 | 17800 | 0.4127 | | 0.4043 | 32.3562 | 17900 | 0.4080 | | 0.4041 | 32.5369 | 18000 | 0.4069 | | 0.4046 | 32.7177 | 18100 | 0.4078 | | 0.401 | 32.8985 | 18200 | 0.4081 | | 0.4019 | 33.0777 | 18300 | 0.4113 | | 0.4005 | 33.2585 | 18400 | 0.4083 | | 0.4058 | 33.4393 | 18500 | 0.4083 | | 0.4031 | 33.6201 | 18600 | 0.4089 | | 0.4027 | 33.8009 | 18700 | 0.4092 | | 0.4005 | 33.9817 | 18800 | 0.4102 | | 0.3994 | 34.1609 | 18900 | 0.4086 | | 0.4017 | 34.3417 | 19000 | 0.4113 | | 0.4002 | 34.5225 | 19100 | 0.4114 | | 0.4018 | 34.7033 | 19200 | 0.4117 | | 0.3996 | 34.8841 | 19300 | 0.4089 | | 0.402 | 35.0633 | 19400 | 0.4101 | | 0.3999 | 35.2441 | 19500 | 0.4125 | | 0.401 | 35.4249 | 19600 | 0.4144 | | 0.3983 | 35.6056 | 19700 | 0.4122 | | 0.4008 | 35.7864 | 19800 | 0.4106 | | 0.4036 | 35.9672 | 19900 | 0.4084 | | 0.3991 | 36.1464 | 20000 | 0.4149 | | 0.4022 | 36.3272 | 20100 | 0.4183 | | 0.3966 | 36.5080 | 20200 | 0.4134 | | 0.3977 | 36.6888 | 20300 | 0.4113 | | 0.4031 | 36.8696 | 20400 | 0.4136 | | 0.3977 | 37.0488 | 20500 | 0.4127 | | 0.3951 | 37.2296 | 20600 | 0.4145 | | 0.3977 | 37.4104 | 20700 | 0.4126 | | 0.3984 | 37.5912 | 20800 | 0.4091 | | 0.4003 | 37.7720 | 20900 | 0.4107 | | 0.3994 | 37.9528 | 21000 | 0.4102 | | 0.3996 | 38.1320 | 21100 | 0.4132 | | 0.3976 | 38.3128 | 21200 | 0.4152 | | 0.3982 | 38.4936 | 21300 | 0.4085 | | 0.3993 | 38.6744 | 21400 | 0.4112 | | 0.3969 | 38.8551 | 21500 | 0.4104 | | 0.3845 | 39.0344 | 21600 | 0.4127 | | 0.3985 | 39.2151 | 21700 | 0.4116 | | 0.3949 | 39.3959 | 21800 | 0.4121 | | 0.3998 | 39.5767 | 21900 | 0.4108 | | 0.399 | 39.7575 | 22000 | 0.4106 | | 0.3994 | 39.9383 | 22100 | 0.4164 | | 0.398 | 40.1175 | 22200 | 0.4125 | | 0.396 | 40.2983 | 22300 | 0.4138 | | 0.3953 | 40.4791 | 22400 | 0.4104 | | 0.3951 | 40.6599 | 22500 | 0.4190 | | 0.3967 | 40.8407 | 22600 | 0.4120 | | 0.3809 | 41.0199 | 22700 | 0.4141 | | 0.3966 | 41.2007 | 22800 | 0.4141 | | 0.3965 | 41.3815 | 22900 | 0.4132 | | 0.396 | 41.5623 | 23000 | 0.4114 | | 0.3949 | 41.7431 | 23100 | 0.4120 | | 0.3989 | 41.9238 | 23200 | 0.4149 | | 0.3962 | 42.1031 | 23300 | 0.4115 | | 0.3957 | 42.2838 | 23400 | 0.4131 | | 0.3951 | 42.4646 | 23500 | 0.4153 | | 0.3953 | 42.6454 | 23600 | 0.4147 | | 0.3952 | 42.8262 | 23700 | 0.4110 | | 0.3817 | 43.0054 | 23800 | 0.4150 | | 0.3987 | 43.1862 | 23900 | 0.4156 | | 0.3946 | 43.3670 | 24000 | 0.4156 | | 0.3939 | 43.5478 | 24100 | 0.4123 | | 0.3938 | 43.7286 | 24200 | 0.4161 | | 0.3958 | 43.9094 | 24300 | 0.4183 | | 0.3955 | 44.0886 | 24400 | 0.4157 | | 0.3949 | 44.2694 | 24500 | 0.4145 | | 0.3951 | 44.4502 | 24600 | 0.4151 | | 0.3982 | 44.6310 | 24700 | 0.4167 | | 0.3962 | 44.8118 | 24800 | 0.4133 | | 0.3927 | 44.9925 | 24900 | 0.4180 | | 0.3951 | 45.1718 | 25000 | 0.4119 | | 0.3937 | 45.3525 | 25100 | 0.4153 | | 0.3942 | 45.5333 | 25200 | 0.4152 | | 0.3968 | 45.7141 | 25300 | 0.4141 | | 0.3935 | 45.8949 | 25400 | 0.4121 | | 0.3912 | 46.0741 | 25500 | 0.4161 | | 0.391 | 46.2549 | 25600 | 0.4120 | | 0.3942 | 46.4357 | 25700 | 0.4167 | | 0.3931 | 46.6165 | 25800 | 0.4157 | | 0.3933 | 46.7973 | 25900 | 0.4171 | | 0.3954 | 46.9781 | 26000 | 0.4175 | | 0.3926 | 47.1573 | 26100 | 0.4124 | | 0.3929 | 47.3381 | 26200 | 0.4148 | | 0.3955 | 47.5189 | 26300 | 0.4183 | | 0.3963 | 47.6997 | 26400 | 0.4152 | | 0.3928 | 47.8805 | 26500 | 0.4154 | | 0.3929 | 48.0597 | 26600 | 0.4140 | | 0.3945 | 48.2405 | 26700 | 0.4200 | | 0.3938 | 48.4212 | 26800 | 0.4159 | | 0.39 | 48.6020 | 26900 | 0.4132 | | 0.3922 | 48.7828 | 27000 | 0.4195 | | 0.3928 | 48.9636 | 27100 | 0.4168 | | 0.3931 | 49.1428 | 27200 | 0.4177 | | 0.3915 | 49.3236 | 27300 | 0.4157 | | 0.3911 | 49.5044 | 27400 | 0.4167 | | 0.3919 | 49.6852 | 27500 | 0.4188 | | 0.3936 | 49.8660 | 27600 | 0.4137 | | 0.3924 | 50.0452 | 27700 | 0.4162 | | 0.3911 | 50.2260 | 27800 | 0.4165 | | 0.3942 | 50.4068 | 27900 | 0.4186 | | 0.3895 | 50.5876 | 28000 | 0.4165 | | 0.3907 | 50.7684 | 28100 | 0.4217 | | 0.3885 | 50.9492 | 28200 | 0.4166 | | 0.3918 | 51.1284 | 28300 | 0.4171 | | 0.3885 | 51.3092 | 28400 | 0.4153 | | 0.3899 | 51.4899 | 28500 | 0.4161 | | 0.3933 | 51.6707 | 28600 | 0.4176 | | 0.3911 | 51.8515 | 28700 | 0.4160 | | 0.3771 | 52.0307 | 28800 | 0.4169 | | 0.393 | 52.2115 | 28900 | 0.4188 | | 0.3901 | 52.3923 | 29000 | 0.4145 | | 0.3918 | 52.5731 | 29100 | 0.4176 | | 0.3901 | 52.7539 | 29200 | 0.4179 | | 0.3928 | 52.9347 | 29300 | 0.4179 | | 0.3883 | 53.1139 | 29400 | 0.4172 | | 0.3886 | 53.2947 | 29500 | 0.4205 | | 0.3876 | 53.4755 | 29600 | 0.4184 | | 0.3939 | 53.6563 | 29700 | 0.4168 | | 0.3906 | 53.8371 | 29800 | 0.4165 | | 0.3763 | 54.0163 | 29900 | 0.4173 | | 0.3902 | 54.1971 | 30000 | 0.4165 | | 0.3886 | 54.3779 | 30100 | 0.4175 | | 0.3889 | 54.5586 | 30200 | 0.4191 | | 0.3926 | 54.7394 | 30300 | 0.4196 | | 0.389 | 54.9202 | 30400 | 0.4182 | | 0.3921 | 55.0994 | 30500 | 0.4196 | | 0.3923 | 55.2802 | 30600 | 0.4196 | | 0.3882 | 55.4610 | 30700 | 0.4202 | | 0.3906 | 55.6418 | 30800 | 0.4187 | | 0.3902 | 55.8226 | 30900 | 0.4187 | | 0.3751 | 56.0018 | 31000 | 0.4189 | | 0.3874 | 56.1826 | 31100 | 0.4208 | | 0.3907 | 56.3634 | 31200 | 0.4198 | | 0.3915 | 56.5442 | 31300 | 0.4197 | | 0.3872 | 56.7250 | 31400 | 0.4216 | | 0.3905 | 56.9058 | 31500 | 0.4208 | | 0.3893 | 57.0850 | 31600 | 0.4207 | | 0.3904 | 57.2658 | 31700 | 0.4228 | | 0.3872 | 57.4466 | 31800 | 0.4217 | | 0.3878 | 57.6273 | 31900 | 0.4205 | | 0.3899 | 57.8081 | 32000 | 0.4220 | | 0.3865 | 57.9889 | 32100 | 0.4212 | | 0.388 | 58.1681 | 32200 | 0.4181 | | 0.3878 | 58.3489 | 32300 | 0.4194 | | 0.3917 | 58.5297 | 32400 | 0.4188 | | 0.3894 | 58.7105 | 32500 | 0.4202 | | 0.3876 | 58.8913 | 32600 | 0.4224 | | 0.3903 | 59.0705 | 32700 | 0.4207 | | 0.3887 | 59.2513 | 32800 | 0.4200 | | 0.3871 | 59.4321 | 32900 | 0.4208 | | 0.3867 | 59.6129 | 33000 | 0.4220 | | 0.3864 | 59.7937 | 33100 | 0.4187 | | 0.3881 | 59.9745 | 33200 | 0.4215 | | 0.3853 | 60.1537 | 33300 | 0.4197 | | 0.3883 | 60.3345 | 33400 | 0.4202 | | 0.3883 | 60.5153 | 33500 | 0.4189 | | 0.3879 | 60.6960 | 33600 | 0.4198 | | 0.3919 | 60.8768 | 33700 | 0.4195 | | 0.3898 | 61.0560 | 33800 | 0.4199 | | 0.3877 | 61.2368 | 33900 | 0.4218 | | 0.3869 | 61.4176 | 34000 | 0.4216 | | 0.3898 | 61.5984 | 34100 | 0.4209 | | 0.3877 | 61.7792 | 34200 | 0.4201 | | 0.3857 | 61.96 | 34300 | 0.4216 | | 0.3869 | 62.1392 | 34400 | 0.4207 | | 0.3863 | 62.32 | 34500 | 0.4227 | | 0.387 | 62.5008 | 34600 | 0.4216 | | 0.386 | 62.6816 | 34700 | 0.4227 | | 0.3885 | 62.8624 | 34800 | 0.4200 | | 0.3726 | 63.0416 | 34900 | 0.4223 | | 0.3894 | 63.2224 | 35000 | 0.4240 | | 0.386 | 63.4032 | 35100 | 0.4219 | | 0.3875 | 63.5840 | 35200 | 0.4217 | | 0.3854 | 63.7647 | 35300 | 0.4207 | | 0.3849 | 63.9455 | 35400 | 0.4207 | | 0.3879 | 64.1247 | 35500 | 0.4229 | | 0.3864 | 64.3055 | 35600 | 0.4216 | | 0.3845 | 64.4863 | 35700 | 0.4219 | | 0.3853 | 64.6671 | 35800 | 0.4200 | | 0.3927 | 64.8479 | 35900 | 0.4214 | | 0.3747 | 65.0271 | 36000 | 0.4207 | | 0.3858 | 65.2079 | 36100 | 0.4222 | | 0.3879 | 65.3887 | 36200 | 0.4225 | | 0.3886 | 65.5695 | 36300 | 0.4222 | | 0.3851 | 65.7503 | 36400 | 0.4222 | | 0.3875 | 65.9311 | 36500 | 0.4239 | | 0.3859 | 66.1103 | 36600 | 0.4231 | | 0.3878 | 66.2911 | 36700 | 0.4227 | | 0.3873 | 66.4719 | 36800 | 0.4257 | | 0.385 | 66.6527 | 36900 | 0.4239 | | 0.3853 | 66.8334 | 37000 | 0.4236 | | 0.3691 | 67.0127 | 37100 | 0.4251 | | 0.3888 | 67.1934 | 37200 | 0.4256 | | 0.3844 | 67.3742 | 37300 | 0.4222 | | 0.387 | 67.5550 | 37400 | 0.4233 | | 0.3853 | 67.7358 | 37500 | 0.4224 | | 0.3846 | 67.9166 | 37600 | 0.4237 | | 0.3869 | 68.0958 | 37700 | 0.4246 | | 0.3827 | 68.2766 | 37800 | 0.4232 | | 0.3838 | 68.4574 | 37900 | 0.4225 | | 0.3849 | 68.6382 | 38000 | 0.4245 | | 0.3885 | 68.8190 | 38100 | 0.4241 | | 0.3878 | 68.9998 | 38200 | 0.4238 | | 0.3858 | 69.1790 | 38300 | 0.4247 | | 0.3853 | 69.3598 | 38400 | 0.4247 | | 0.3883 | 69.5406 | 38500 | 0.4248 | | 0.3895 | 69.7214 | 38600 | 0.4258 | | 0.3858 | 69.9021 | 38700 | 0.4236 | | 0.3876 | 70.0814 | 38800 | 0.4241 | | 0.3865 | 70.2621 | 38900 | 0.4248 | | 0.3859 | 70.4429 | 39000 | 0.4259 | | 0.3872 | 70.6237 | 39100 | 0.4247 | | 0.3823 | 70.8045 | 39200 | 0.4247 | | 0.385 | 70.9853 | 39300 | 0.4251 | | 0.3852 | 71.1645 | 39400 | 0.4252 | | 0.3858 | 71.3453 | 39500 | 0.4255 | | 0.3826 | 71.5261 | 39600 | 0.4253 | | 0.3877 | 71.7069 | 39700 | 0.4251 | | 0.3861 | 71.8877 | 39800 | 0.4253 | | 0.3845 | 72.0669 | 39900 | 0.4248 | | 0.3857 | 72.2477 | 40000 | 0.4252 | ### Framework versions - Transformers 4.48.0 - Pytorch 2.2.1 - Datasets 3.2.0 - Tokenizers 0.21.0