Matt6450 commited on
Commit
3223679
·
1 Parent(s): eaae42c

Training in progress epoch 0

Browse files
README.md CHANGED
@@ -4,24 +4,24 @@ base_model: microsoft/layoutlm-base-uncased
4
  tags:
5
  - generated_from_keras_callback
6
  model-index:
7
- - name: layoutlm-funsd-tf
8
  results: []
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
12
  probably proofread and complete it, then remove this comment. -->
13
 
14
- # layoutlm-funsd-tf
15
 
16
  This model is a fine-tuned version of [microsoft/layoutlm-base-uncased](https://huggingface.co/microsoft/layoutlm-base-uncased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Train Loss: 0.2505
19
- - Validation Loss: 0.6780
20
- - Train Overall Precision: 0.7377
21
- - Train Overall Recall: 0.7973
22
- - Train Overall F1: 0.7663
23
- - Train Overall Accuracy: 0.8061
24
- - Epoch: 7
25
 
26
  ## Model description
27
 
@@ -40,21 +40,14 @@ More information needed
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
- - optimizer: {'inner_optimizer': {'module': 'transformers.optimization_tf', 'class_name': 'AdamWeightDecay', 'config': {'name': 'AdamWeightDecay', 'learning_rate': 2.9999999242136255e-05, 'decay': 0.0, 'beta_1': 0.8999999761581421, 'beta_2': 0.9990000128746033, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}, 'registered_name': 'AdamWeightDecay'}, 'dynamic': True, 'initial_scale': 32768.0, 'dynamic_growth_steps': 2000}
44
  - training_precision: mixed_float16
45
 
46
  ### Training results
47
 
48
  | Train Loss | Validation Loss | Train Overall Precision | Train Overall Recall | Train Overall F1 | Train Overall Accuracy | Epoch |
49
  |:----------:|:---------------:|:-----------------------:|:--------------------:|:----------------:|:----------------------:|:-----:|
50
- | 1.7445 | 1.4591 | 0.2596 | 0.3161 | 0.2851 | 0.4800 | 0 |
51
- | 1.1898 | 0.8586 | 0.5794 | 0.6498 | 0.6126 | 0.7318 | 1 |
52
- | 0.7791 | 0.7008 | 0.6577 | 0.7637 | 0.7068 | 0.7795 | 2 |
53
- | 0.5866 | 0.6335 | 0.7161 | 0.7807 | 0.7470 | 0.8039 | 3 |
54
- | 0.4528 | 0.6048 | 0.7234 | 0.7978 | 0.7588 | 0.8174 | 4 |
55
- | 0.3675 | 0.6302 | 0.7118 | 0.7943 | 0.7508 | 0.8112 | 5 |
56
- | 0.3039 | 0.6413 | 0.7297 | 0.8018 | 0.7640 | 0.8110 | 6 |
57
- | 0.2505 | 0.6780 | 0.7377 | 0.7973 | 0.7663 | 0.8061 | 7 |
58
 
59
 
60
  ### Framework versions
 
4
  tags:
5
  - generated_from_keras_callback
6
  model-index:
7
+ - name: Matt6450/layoutlm-funsd-tf
8
  results: []
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
12
  probably proofread and complete it, then remove this comment. -->
13
 
14
+ # Matt6450/layoutlm-funsd-tf
15
 
16
  This model is a fine-tuned version of [microsoft/layoutlm-base-uncased](https://huggingface.co/microsoft/layoutlm-base-uncased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Train Loss: 1.8669
19
+ - Validation Loss: 1.6316
20
+ - Train Overall Precision: 0.0652
21
+ - Train Overall Recall: 0.0502
22
+ - Train Overall F1: 0.0567
23
+ - Train Overall Accuracy: 0.3485
24
+ - Epoch: 0
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - optimizer: {'inner_optimizer': {'module': 'transformers.optimization_tf', 'class_name': 'AdamWeightDecay', 'config': {'name': 'AdamWeightDecay', 'learning_rate': 1.9999999494757503e-05, 'decay': 0.0, 'beta_1': 0.8999999761581421, 'beta_2': 0.9990000128746033, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}, 'registered_name': 'AdamWeightDecay'}, 'dynamic': True, 'initial_scale': 32768.0, 'dynamic_growth_steps': 2000}
44
  - training_precision: mixed_float16
45
 
46
  ### Training results
47
 
48
  | Train Loss | Validation Loss | Train Overall Precision | Train Overall Recall | Train Overall F1 | Train Overall Accuracy | Epoch |
49
  |:----------:|:---------------:|:-----------------------:|:--------------------:|:----------------:|:----------------------:|:-----:|
50
+ | 1.8669 | 1.6316 | 0.0652 | 0.0502 | 0.0567 | 0.3485 | 0 |
 
 
 
 
 
 
 
51
 
52
 
53
  ### Framework versions
logs/train/events.out.tfevents.1707203791.73191d6d4cc9.315.0.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5606866406fbcc289954a51b995a8937372a0610e3cf587d147a38b8f61772bd
3
+ size 78
logs/train/events.out.tfevents.1707203859.73191d6d4cc9.315.1.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a5f7db7a3c9decc10632d99fde3e288a8057666bdc710bc327b5304544262c9
3
+ size 78
logs/train/events.out.tfevents.1707203949.73191d6d4cc9.315.2.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71c21603de90c6b889824c302412b7c3711af09aaf95695bab1399fdd61bb464
3
+ size 2855925
logs/validation/events.out.tfevents.1707203976.73191d6d4cc9.315.3.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37d1008415ac728b6ef10ac137fc2302793b3dd4d9ae0563208a0df721315f4b
3
+ size 231
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6f3e95efd9bb911a77f8134108fe21873852c1de02d8e8a8a3ecec768ca6247b
3
  size 450829256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4702c7c55cafefe6cc4710e8cd0c8d2fc8824cf93ae943ab85259d896076de1
3
  size 450829256