jzygeorge commited on
Commit
38a7d5a
·
1 Parent(s): 9742ce4

End of training

Browse files
README.md CHANGED
@@ -16,14 +16,14 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [SCUT-DLVCLab/lilt-roberta-en-base](https://huggingface.co/SCUT-DLVCLab/lilt-roberta-en-base) on the funsd-layoutlmv3 dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.9729
20
- - Answer: {'precision': 0.5061511423550088, 'recall': 0.7050183598531212, 'f1': 0.5892583120204603, 'number': 817}
21
- - Header: {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119}
22
- - Question: {'precision': 0.6674400618716164, 'recall': 0.8012999071494893, 'f1': 0.7282700421940929, 'number': 1077}
23
- - Overall Precision: 0.5840
24
- - Overall Recall: 0.7149
25
- - Overall F1: 0.6428
26
- - Overall Accuracy: 0.5953
27
 
28
  ## Model description
29
 
@@ -48,14 +48,13 @@ The following hyperparameters were used during training:
48
  - seed: 42
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
- - training_steps: 40
52
 
53
  ### Training results
54
 
55
- | Training Loss | Epoch | Step | Validation Loss | Answer | Header | Question | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
56
- |:-------------:|:-----:|:----:|:---------------:|:----------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
57
- | 1.5938 | 0.27 | 20 | 1.1884 | {'precision': 0.3494347379239466, 'recall': 0.41615667074663404, 'f1': 0.37988826815642457, 'number': 817} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.4942455242966752, 'recall': 0.7177344475394615, 'f1': 0.5853843241196517, 'number': 1077} | 0.4387 | 0.5529 | 0.4892 | 0.5421 |
58
- | 1.1521 | 0.53 | 40 | 0.9729 | {'precision': 0.5061511423550088, 'recall': 0.7050183598531212, 'f1': 0.5892583120204603, 'number': 817} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.6674400618716164, 'recall': 0.8012999071494893, 'f1': 0.7282700421940929, 'number': 1077} | 0.5840 | 0.7149 | 0.6428 | 0.5953 |
59
 
60
 
61
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [SCUT-DLVCLab/lilt-roberta-en-base](https://huggingface.co/SCUT-DLVCLab/lilt-roberta-en-base) on the funsd-layoutlmv3 dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.6139
20
+ - Answer: {'precision': 0.8076923076923077, 'recall': 0.8739290085679314, 'f1': 0.8395061728395062, 'number': 817}
21
+ - Header: {'precision': 0.3148148148148148, 'recall': 0.42857142857142855, 'f1': 0.36298932384341637, 'number': 119}
22
+ - Question: {'precision': 0.796595744680851, 'recall': 0.8690807799442897, 'f1': 0.8312611012433393, 'number': 1077}
23
+ - Overall Precision: 0.7659
24
+ - Overall Recall: 0.8450
25
+ - Overall F1: 0.8035
26
+ - Overall Accuracy: 0.8009
27
 
28
  ## Model description
29
 
 
48
  - seed: 42
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
+ - training_steps: 260
52
 
53
  ### Training results
54
 
55
+ | Training Loss | Epoch | Step | Validation Loss | Answer | Header | Question | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
56
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
57
+ | 0.7536 | 2.67 | 200 | 0.6139 | {'precision': 0.8076923076923077, 'recall': 0.8739290085679314, 'f1': 0.8395061728395062, 'number': 817} | {'precision': 0.3148148148148148, 'recall': 0.42857142857142855, 'f1': 0.36298932384341637, 'number': 119} | {'precision': 0.796595744680851, 'recall': 0.8690807799442897, 'f1': 0.8312611012433393, 'number': 1077} | 0.7659 | 0.8450 | 0.8035 | 0.8009 |
 
58
 
59
 
60
  ### Framework versions
logs/events.out.tfevents.1677026224.c4ac2e57e392.51574.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:15db5f69a30a811251a80ec503bbd707124fa5fa031c87f983476a3d78041a37
3
- size 4914
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cb9e73b8ddce86d8a1882750ea3aff9255ce5992ba96f0d20b41775c17af2be
3
+ size 5268
logs/events.out.tfevents.1677031076.c4ac2e57e392.51574.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:015225e6c077a04fd3c737f82a8f3328ad7058a1747ec1b68b5f0fd03737c01e
3
+ size 592
tokenizer.json CHANGED
@@ -1,21 +1,7 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 512,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
- "padding": {
10
- "strategy": {
11
- "Fixed": 512
12
- },
13
- "direction": "Right",
14
- "pad_to_multiple_of": null,
15
- "pad_id": 1,
16
- "pad_type_id": 0,
17
- "pad_token": "<pad>"
18
- },
19
  "added_tokens": [
20
  {
21
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
4
+ "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,