test-mod

This model is a fine-tuned version of microsoft/layoutlmv2-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 3.7093

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 4
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss
4.4543	0.4425	100	4.1263
3.8184	0.8850	200	3.6020
3.1679	1.3274	300	3.2677
2.8445	1.7699	400	2.7349
2.1075	2.2124	500	2.7777
2.0023	2.6549	600	2.2916
1.6039	3.0973	700	2.9570
1.3588	3.5398	800	2.3464
1.2134	3.9823	900	2.5250
1.0646	4.4248	1000	2.4559
0.9066	4.8673	1100	2.8075
0.7531	5.3097	1200	2.6887
0.5598	5.7522	1300	3.2975
0.4299	6.1947	1400	3.3297
0.3816	6.6372	1500	3.4080
0.5005	7.0796	1600	2.9232
0.3535	7.5221	1700	3.5700
0.2528	7.9646	1800	3.4312
0.1815	8.4071	1900	3.6603
0.3175	8.8496	2000	3.7269
0.1152	9.2920	2100	3.7923
0.2856	9.7345	2200	3.7093

Framework versions

• Transformers 4.42.3
• Pytorch 2.1.2
• Datasets 2.20.0
• Tokenizers 0.19.1