disk0dancer commited on
Commit
7dfdfa4
·
verified ·
1 Parent(s): 5b492dd

End of training

Browse files
README.md CHANGED
@@ -1,13 +1,6 @@
1
  ---
2
- license: apache-2.0
3
- base_model: ai-forever/ruBert-base
4
  tags:
5
  - generated_from_trainer
6
- metrics:
7
- - precision
8
- - recall
9
- - f1
10
- - accuracy
11
  model-index:
12
  - name: ruBert-base-finetuned-pos
13
  results: []
@@ -18,13 +11,17 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  # ruBert-base-finetuned-pos
20
 
21
- This model is a fine-tuned version of [ai-forever/ruBert-base](https://huggingface.co/ai-forever/ruBert-base) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.1544
24
- - Precision: 0.8561
25
- - Recall: 0.8723
26
- - F1: 0.8642
27
- - Accuracy: 0.8822
 
 
 
 
28
 
29
  ## Model description
30
 
@@ -44,24 +41,13 @@ More information needed
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
- - train_batch_size: 64
48
- - eval_batch_size: 64
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
  - num_epochs: 5
53
 
54
- ### Training results
55
-
56
- | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
- |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
- | No log | 1.0 | 311 | 0.1686 | 0.8380 | 0.8440 | 0.8410 | 0.8565 |
59
- | 0.0464 | 2.0 | 622 | 0.1597 | 0.8462 | 0.8582 | 0.8521 | 0.8715 |
60
- | 0.0464 | 3.0 | 933 | 0.1544 | 0.8561 | 0.8723 | 0.8642 | 0.8822 |
61
- | 0.0046 | 4.0 | 1244 | 0.1564 | 0.8469 | 0.8629 | 0.8548 | 0.8737 |
62
- | 0.0029 | 5.0 | 1555 | 0.1556 | 0.8538 | 0.8700 | 0.8618 | 0.8801 |
63
-
64
-
65
  ### Framework versions
66
 
67
  - Transformers 4.39.0
 
1
  ---
 
 
2
  tags:
3
  - generated_from_trainer
 
 
 
 
 
4
  model-index:
5
  - name: ruBert-base-finetuned-pos
6
  results: []
 
11
 
12
  # ruBert-base-finetuned-pos
13
 
14
+ This model was trained from scratch on the None dataset.
15
  It achieves the following results on the evaluation set:
16
+ - eval_loss: 0.1544
17
+ - eval_precision: 0.8561
18
+ - eval_recall: 0.8723
19
+ - eval_f1: 0.8642
20
+ - eval_accuracy: 0.8822
21
+ - eval_runtime: 0.2476
22
+ - eval_samples_per_second: 80.775
23
+ - eval_steps_per_second: 8.078
24
+ - step: 0
25
 
26
  ## Model description
27
 
 
41
 
42
  The following hyperparameters were used during training:
43
  - learning_rate: 2e-05
44
+ - train_batch_size: 16
45
+ - eval_batch_size: 16
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
  - num_epochs: 5
50
 
 
 
 
 
 
 
 
 
 
 
 
51
  ### Framework versions
52
 
53
  - Transformers 4.39.0
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "ai-forever/ruBert-base",
3
  "architectures": [
4
  "BertForTokenClassification"
5
  ],
 
1
  {
2
+ "_name_or_path": "disk0dancer/ruBert-base-finetuned-pos",
3
  "architectures": [
4
  "BertForTokenClassification"
5
  ],
runs/Mar22_14-23-33_699a7512e26d/events.out.tfevents.1711117413.699a7512e26d.2634.8 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b7058766bd691943b06affe67d740f6b5bbafb158dbed776f83fc2de25aefc9
3
+ size 486
special_tokens_map.json CHANGED
@@ -1,7 +1,37 @@
1
  {
2
- "cls_token": "[CLS]",
3
- "mask_token": "[MASK]",
4
- "pad_token": "[PAD]",
5
- "sep_token": "[SEP]",
6
- "unk_token": "[UNK]"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  }
 
1
  {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
  }
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:649bd3e5422e5c107fa0e02304498cf8371f173894beff1d4048532b4b8512e4
3
- size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34bc76b0557eb7f8a7a476ab0190c118a6c48b3026a2da0b78707ea10a67f7bb
3
+ size 4984