Hugging Face's logo

phonemetransformers
/
childes-multilingual-5M-gpt2_lm-model

Text Generation
Transformers
Safetensors
gpt2
Mandarin2
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
codebyzeb commited on
Commit
7f0fc5f
·
verified ·
1 Parent(s): 71df141

Final model for experiment Spanish

Browse files
Files changed (6) hide show
  1. README.md +54 -54
  2. config.json +1 -1
  3. model.safetensors +2 -2
  4. tokenizer.json +26 -34
  5. training_args.bin +1 -1
  6. vocab.json +1 -1
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  library_name: transformers
3
  tags:
4
- - French
5
  - generated_from_trainer
6
  model-index:
7
  - name: childes-multilingual-5M-gpt2_lm-model
@@ -15,50 +15,50 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 1.9064
19
  - Model Preparation Time: 0.0013
20
- - Perplexity: 6.7288
21
- - Bpc: 2.7504
22
- - Spike Seg Type Fscore Entropy: 0.3875
23
- - Spike Seg Boundary Fscore Entropy: 0.6846
24
- - Absolute Seg Type Fscore Entropy: 0.3618
25
- - Absolute Seg Boundary Fscore Entropy: 0.6682
26
- - Spike Seg Type Fscore Increase in entropy: 0.3764
27
- - Spike Seg Boundary Fscore Increase in entropy: 0.6962
28
- - Absolute Seg Type Fscore Increase in entropy: 0.4313
29
- - Absolute Seg Boundary Fscore Increase in entropy: 0.7143
30
- - Spike Seg Type Fscore Loss: 0.2982
31
- - Spike Seg Boundary Fscore Loss: 0.5896
32
- - Absolute Seg Type Fscore Loss: 0.0825
33
- - Absolute Seg Boundary Fscore Loss: 0.6192
34
- - Spike Seg Type Fscore Increase in loss: 0.3513
35
- - Spike Seg Boundary Fscore Increase in loss: 0.6409
36
- - Absolute Seg Type Fscore Increase in loss: 0.3705
37
- - Absolute Seg Boundary Fscore Increase in loss: 0.6799
38
- - Spike Seg Type Fscore Rank: 0.3400
39
- - Spike Seg Boundary Fscore Rank: 0.5935
40
- - Absolute Seg Type Fscore Rank: 0.2872
41
- - Absolute Seg Boundary Fscore Rank: 0.5925
42
- - Spike Seg Type Fscore Increase in rank: 0.3811
43
- - Spike Seg Boundary Fscore Increase in rank: 0.6353
44
- - Absolute Seg Type Fscore Increase in rank: 0.3957
45
- - Absolute Seg Boundary Fscore Increase in rank: 0.6510
46
- - Spike Seg Type Fscore Boundary prediction: 0.4180
47
- - Spike Seg Boundary Fscore Boundary prediction: 0.7434
48
- - Absolute Seg Type Fscore Boundary prediction: 0.4754
49
- - Absolute Seg Boundary Fscore Boundary prediction: 0.7530
50
- - Spike Seg Type Fscore Increase in boundary prediction: 0.4018
51
- - Spike Seg Boundary Fscore Increase in boundary prediction: 0.7381
52
- - Absolute Seg Type Fscore Increase in boundary prediction: 0.4435
53
- - Absolute Seg Boundary Fscore Increase in boundary prediction: 0.7535
54
- - Spike Seg Type Fscore Majority vote cutoff: 0.4497
55
- - Spike Seg Type Fscore Majority vote spike: 0.3719
56
- - Absolute Seg Type Fscore Majority vote cutoff: 0.4895
57
- - Absolute Seg Type Fscore Majority vote spike: 0.4271
58
- - Spike Seg Boundary Fscore Majority vote cutoff: 0.7474
59
- - Spike Seg Boundary Fscore Majority vote spike: 0.7095
60
- - Absolute Seg Boundary Fscore Majority vote cutoff: 0.7678
61
- - Absolute Seg Boundary Fscore Majority vote spike: 0.7076
62
 
63
  ## Model description
64
 
@@ -90,16 +90,16 @@ The following hyperparameters were used during training:
90
 
91
  | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Perplexity | Bpc | Spike Seg Type Fscore Entropy | Spike Seg Boundary Fscore Entropy | Absolute Seg Type Fscore Entropy | Absolute Seg Boundary Fscore Entropy | Spike Seg Type Fscore Increase in entropy | Spike Seg Boundary Fscore Increase in entropy | Absolute Seg Type Fscore Increase in entropy | Absolute Seg Boundary Fscore Increase in entropy | Spike Seg Type Fscore Loss | Spike Seg Boundary Fscore Loss | Absolute Seg Type Fscore Loss | Absolute Seg Boundary Fscore Loss | Spike Seg Type Fscore Increase in loss | Spike Seg Boundary Fscore Increase in loss | Absolute Seg Type Fscore Increase in loss | Absolute Seg Boundary Fscore Increase in loss | Spike Seg Type Fscore Rank | Spike Seg Boundary Fscore Rank | Absolute Seg Type Fscore Rank | Absolute Seg Boundary Fscore Rank | Spike Seg Type Fscore Increase in rank | Spike Seg Boundary Fscore Increase in rank | Absolute Seg Type Fscore Increase in rank | Absolute Seg Boundary Fscore Increase in rank | Spike Seg Type Fscore Boundary prediction | Spike Seg Boundary Fscore Boundary prediction | Absolute Seg Type Fscore Boundary prediction | Absolute Seg Boundary Fscore Boundary prediction | Spike Seg Type Fscore Increase in boundary prediction | Spike Seg Boundary Fscore Increase in boundary prediction | Absolute Seg Type Fscore Increase in boundary prediction | Absolute Seg Boundary Fscore Increase in boundary prediction | Spike Seg Type Fscore Majority vote cutoff | Spike Seg Type Fscore Majority vote spike | Absolute Seg Type Fscore Majority vote cutoff | Absolute Seg Type Fscore Majority vote spike | Spike Seg Boundary Fscore Majority vote cutoff | Spike Seg Boundary Fscore Majority vote spike | Absolute Seg Boundary Fscore Majority vote cutoff | Absolute Seg Boundary Fscore Majority vote spike |
92
  |:-------------:|:--------:|:------:|:---------------:|:----------------------:|:----------:|:------:|:-----------------------------:|:---------------------------------:|:--------------------------------:|:------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:-----------------------------------------------------:|:---------------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:----------------------------------------------:|:---------------------------------------------:|:-------------------------------------------------:|:------------------------------------------------:|
93
- | 1.6754 | 45.2489 | 20000 | 1.7720 | 0.0013 | 5.8828 | 2.5565 | 0.3717 | 0.6768 | 0.3538 | 0.6617 | 0.3622 | 0.6951 | 0.4021 | 0.7115 | 0.3222 | 0.6188 | 0.2789 | 0.6208 | 0.3631 | 0.6591 | 0.3771 | 0.6878 | 0.3342 | 0.5954 | 0.2794 | 0.5899 | 0.3739 | 0.6371 | 0.3982 | 0.6551 | 0.3964 | 0.7277 | 0.3329 | 0.6667 | 0.3880 | 0.7320 | 0.3343 | 0.7118 | 0.4497 | 0.3687 | 0.4469 | 0.4274 | 0.7404 | 0.7086 | 0.7449 | 0.7144 |
94
- | 1.5518 | 90.4977 | 40000 | 1.7262 | 0.0013 | 5.6190 | 2.4903 | 0.3859 | 0.6881 | 0.3516 | 0.6762 | 0.3779 | 0.7088 | 0.4343 | 0.7261 | 0.3322 | 0.6185 | 0.2959 | 0.6251 | 0.3650 | 0.6627 | 0.3863 | 0.6736 | 0.3449 | 0.5923 | 0.2695 | 0.5924 | 0.3859 | 0.6372 | 0.3899 | 0.6534 | 0.4155 | 0.7403 | 0.4286 | 0.7159 | 0.3960 | 0.7357 | 0.4130 | 0.7317 | 0.4435 | 0.3679 | 0.4658 | 0.4333 | 0.7502 | 0.7147 | 0.7537 | 0.7206 |
95
- | 1.4813 | 135.7466 | 60000 | 1.7173 | 0.0013 | 5.5695 | 2.4775 | 0.3863 | 0.6887 | 0.3425 | 0.6777 | 0.3741 | 0.7061 | 0.4229 | 0.7231 | 0.3370 | 0.6161 | 0.2856 | 0.6222 | 0.3744 | 0.6649 | 0.3738 | 0.6926 | 0.3491 | 0.5944 | 0.2767 | 0.5869 | 0.3931 | 0.6402 | 0.4003 | 0.6539 | 0.4234 | 0.7442 | 0.3128 | 0.7261 | 0.4002 | 0.7411 | 0.3633 | 0.5127 | 0.4512 | 0.3729 | 0.4525 | 0.4535 | 0.7424 | 0.7132 | 0.7407 | 0.7246 |
96
- | 1.4002 | 180.9955 | 80000 | 1.7365 | 0.0013 | 5.6777 | 2.5053 | 0.4053 | 0.6989 | 0.3476 | 0.6809 | 0.3870 | 0.7120 | 0.4371 | 0.7314 | 0.3226 | 0.6164 | 0.2892 | 0.6220 | 0.3689 | 0.6593 | 0.3868 | 0.6792 | 0.3472 | 0.5973 | 0.2809 | 0.5905 | 0.3913 | 0.6378 | 0.4031 | 0.6560 | 0.4304 | 0.7480 | 0.3081 | 0.4677 | 0.4042 | 0.7467 | 0.4428 | 0.7475 | 0.4600 | 0.3682 | 0.4845 | 0.4412 | 0.7413 | 0.7169 | 0.7275 | 0.7224 |
97
- | 1.3437 | 226.2443 | 100000 | 1.7769 | 0.0013 | 5.9115 | 2.5635 | 0.3984 | 0.6912 | 0.3701 | 0.6611 | 0.3826 | 0.7087 | 0.4409 | 0.7251 | 0.3087 | 0.6044 | 0.2868 | 0.6216 | 0.3569 | 0.6609 | 0.3848 | 0.6711 | 0.3465 | 0.6042 | 0.2756 | 0.5912 | 0.3943 | 0.6406 | 0.4048 | 0.6585 | 0.4194 | 0.7449 | 0.2913 | 0.7467 | 0.4033 | 0.7419 | 0.4474 | 0.7506 | 0.4641 | 0.3736 | 0.4870 | 0.4417 | 0.7539 | 0.7158 | 0.7604 | 0.7198 |
98
- | 1.3018 | 271.4932 | 120000 | 1.8002 | 0.0013 | 6.0507 | 2.5971 | 0.4 | 0.6922 | 0.3620 | 0.6597 | 0.3882 | 0.7078 | 0.4382 | 0.7235 | 0.3218 | 0.6100 | 0.2948 | 0.6213 | 0.3612 | 0.6549 | 0.3892 | 0.6879 | 0.3558 | 0.5997 | 0.2809 | 0.5910 | 0.3878 | 0.6412 | 0.3974 | 0.6568 | 0.4178 | 0.7437 | 0.4459 | 0.7521 | 0.4062 | 0.7426 | 0.4462 | 0.7469 | 0.4556 | 0.3862 | 0.5047 | 0.4436 | 0.7557 | 0.7158 | 0.7673 | 0.7174 |
99
- | 1.2708 | 316.7421 | 140000 | 1.8412 | 0.0013 | 6.3043 | 2.6563 | 0.3929 | 0.6873 | 0.3544 | 0.6574 | 0.3860 | 0.7051 | 0.4289 | 0.7167 | 0.3032 | 0.5887 | 0.0826 | 0.6241 | 0.3594 | 0.6464 | 0.3732 | 0.6795 | 0.3394 | 0.5953 | 0.2753 | 0.5887 | 0.3882 | 0.6397 | 0.3953 | 0.6545 | 0.4177 | 0.7401 | 0.4536 | 0.7487 | 0.4121 | 0.7388 | 0.1801 | 0.7481 | 0.4448 | 0.3666 | 0.4824 | 0.4286 | 0.7476 | 0.7090 | 0.7564 | 0.7091 |
100
- | 1.2428 | 361.9910 | 160000 | 1.8695 | 0.0013 | 6.4853 | 2.6972 | 0.3982 | 0.6900 | 0.3593 | 0.6681 | 0.3763 | 0.7012 | 0.4361 | 0.7199 | 0.3022 | 0.5917 | 0.0827 | 0.6249 | 0.3606 | 0.6490 | 0.3692 | 0.5773 | 0.3435 | 0.5937 | 0.2731 | 0.5916 | 0.3806 | 0.6347 | 0.3883 | 0.6548 | 0.4203 | 0.7453 | 0.3024 | 0.7485 | 0.4056 | 0.7405 | 0.2585 | 0.7520 | 0.4400 | 0.3728 | 0.4093 | 0.4297 | 0.7490 | 0.7094 | 0.7632 | 0.7100 |
101
- | 1.2188 | 407.2398 | 180000 | 1.8985 | 0.0013 | 6.6760 | 2.7390 | 0.3894 | 0.6845 | 0.3613 | 0.6681 | 0.3823 | 0.7014 | 0.4305 | 0.7156 | 0.3011 | 0.5898 | 0.0827 | 0.6215 | 0.3545 | 0.6389 | 0.3696 | 0.6813 | 0.3354 | 0.5955 | 0.2841 | 0.5888 | 0.3801 | 0.6381 | 0.3877 | 0.6547 | 0.4151 | 0.7413 | 0.4761 | 0.7523 | 0.4004 | 0.7371 | 0.4435 | 0.7516 | 0.4429 | 0.3651 | 0.4910 | 0.4201 | 0.7463 | 0.7071 | 0.7673 | 0.7063 |
102
- | 1.2015 | 452.4887 | 200000 | 1.9064 | 0.0013 | 6.7288 | 2.7504 | 0.3875 | 0.6846 | 0.3618 | 0.6682 | 0.3764 | 0.6962 | 0.4313 | 0.7143 | 0.2982 | 0.5896 | 0.0825 | 0.6192 | 0.3513 | 0.6409 | 0.3705 | 0.6799 | 0.3400 | 0.5935 | 0.2872 | 0.5925 | 0.3811 | 0.6353 | 0.3957 | 0.6510 | 0.4180 | 0.7434 | 0.4754 | 0.7530 | 0.4018 | 0.7381 | 0.4435 | 0.7535 | 0.4497 | 0.3719 | 0.4895 | 0.4271 | 0.7474 | 0.7095 | 0.7678 | 0.7076 |
103
 
104
 
105
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
  tags:
4
+ - Spanish
5
  - generated_from_trainer
6
  model-index:
7
  - name: childes-multilingual-5M-gpt2_lm-model
 
15
 
16
  This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.6555
19
  - Model Preparation Time: 0.0013
20
+ - Perplexity: 5.2355
21
+ - Bpc: 2.3883
22
+ - Spike Seg Type Fscore Entropy: 0.3332
23
+ - Spike Seg Boundary Fscore Entropy: 0.6727
24
+ - Absolute Seg Type Fscore Entropy: 0.3995
25
+ - Absolute Seg Boundary Fscore Entropy: 0.6660
26
+ - Spike Seg Type Fscore Increase in entropy: 0.2810
27
+ - Spike Seg Boundary Fscore Increase in entropy: 0.6403
28
+ - Absolute Seg Type Fscore Increase in entropy: 0.3995
29
+ - Absolute Seg Boundary Fscore Increase in entropy: 0.6829
30
+ - Spike Seg Type Fscore Loss: 0.2547
31
+ - Spike Seg Boundary Fscore Loss: 0.5907
32
+ - Absolute Seg Type Fscore Loss: 0.2617
33
+ - Absolute Seg Boundary Fscore Loss: 0.5870
34
+ - Spike Seg Type Fscore Increase in loss: 0.2604
35
+ - Spike Seg Boundary Fscore Increase in loss: 0.6271
36
+ - Absolute Seg Type Fscore Increase in loss: 0.3425
37
+ - Absolute Seg Boundary Fscore Increase in loss: 0.6148
38
+ - Spike Seg Type Fscore Rank: 0.3266
39
+ - Spike Seg Boundary Fscore Rank: 0.6156
40
+ - Absolute Seg Type Fscore Rank: 0.2731
41
+ - Absolute Seg Boundary Fscore Rank: 0.5804
42
+ - Spike Seg Type Fscore Increase in rank: 0.3286
43
+ - Spike Seg Boundary Fscore Increase in rank: 0.6367
44
+ - Absolute Seg Type Fscore Increase in rank: 0.3916
45
+ - Absolute Seg Boundary Fscore Increase in rank: 0.6459
46
+ - Spike Seg Type Fscore Boundary prediction: 0.2640
47
+ - Spike Seg Boundary Fscore Boundary prediction: 0.6591
48
+ - Absolute Seg Type Fscore Boundary prediction: 0.4087
49
+ - Absolute Seg Boundary Fscore Boundary prediction: 0.6786
50
+ - Spike Seg Type Fscore Increase in boundary prediction: 0.2521
51
+ - Spike Seg Boundary Fscore Increase in boundary prediction: 0.6460
52
+ - Absolute Seg Type Fscore Increase in boundary prediction: 0.3788
53
+ - Absolute Seg Boundary Fscore Increase in boundary prediction: 0.6863
54
+ - Spike Seg Type Fscore Majority vote cutoff: 0.4145
55
+ - Spike Seg Type Fscore Majority vote spike: 0.2634
56
+ - Absolute Seg Type Fscore Majority vote cutoff: 0.4730
57
+ - Absolute Seg Type Fscore Majority vote spike: 0.3846
58
+ - Spike Seg Boundary Fscore Majority vote cutoff: 0.7263
59
+ - Spike Seg Boundary Fscore Majority vote spike: 0.6556
60
+ - Absolute Seg Boundary Fscore Majority vote cutoff: 0.7257
61
+ - Absolute Seg Boundary Fscore Majority vote spike: 0.7086
62
 
63
  ## Model description
64
 
 
90
 
91
  | Training Loss | Epoch | Step | Validation Loss | Model Preparation Time | Perplexity | Bpc | Spike Seg Type Fscore Entropy | Spike Seg Boundary Fscore Entropy | Absolute Seg Type Fscore Entropy | Absolute Seg Boundary Fscore Entropy | Spike Seg Type Fscore Increase in entropy | Spike Seg Boundary Fscore Increase in entropy | Absolute Seg Type Fscore Increase in entropy | Absolute Seg Boundary Fscore Increase in entropy | Spike Seg Type Fscore Loss | Spike Seg Boundary Fscore Loss | Absolute Seg Type Fscore Loss | Absolute Seg Boundary Fscore Loss | Spike Seg Type Fscore Increase in loss | Spike Seg Boundary Fscore Increase in loss | Absolute Seg Type Fscore Increase in loss | Absolute Seg Boundary Fscore Increase in loss | Spike Seg Type Fscore Rank | Spike Seg Boundary Fscore Rank | Absolute Seg Type Fscore Rank | Absolute Seg Boundary Fscore Rank | Spike Seg Type Fscore Increase in rank | Spike Seg Boundary Fscore Increase in rank | Absolute Seg Type Fscore Increase in rank | Absolute Seg Boundary Fscore Increase in rank | Spike Seg Type Fscore Boundary prediction | Spike Seg Boundary Fscore Boundary prediction | Absolute Seg Type Fscore Boundary prediction | Absolute Seg Boundary Fscore Boundary prediction | Spike Seg Type Fscore Increase in boundary prediction | Spike Seg Boundary Fscore Increase in boundary prediction | Absolute Seg Type Fscore Increase in boundary prediction | Absolute Seg Boundary Fscore Increase in boundary prediction | Spike Seg Type Fscore Majority vote cutoff | Spike Seg Type Fscore Majority vote spike | Absolute Seg Type Fscore Majority vote cutoff | Absolute Seg Type Fscore Majority vote spike | Spike Seg Boundary Fscore Majority vote cutoff | Spike Seg Boundary Fscore Majority vote spike | Absolute Seg Boundary Fscore Majority vote cutoff | Absolute Seg Boundary Fscore Majority vote spike |
92
  |:-------------:|:--------:|:------:|:---------------:|:----------------------:|:----------:|:------:|:-----------------------------:|:---------------------------------:|:--------------------------------:|:------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------:|:------------------------------:|:-----------------------------:|:---------------------------------:|:--------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:------------------------------------------------:|:-----------------------------------------------------:|:---------------------------------------------------------:|:--------------------------------------------------------:|:------------------------------------------------------------:|:------------------------------------------:|:-----------------------------------------:|:---------------------------------------------:|:--------------------------------------------:|:----------------------------------------------:|:---------------------------------------------:|:-------------------------------------------------:|:------------------------------------------------:|
93
+ | 1.4761 | 45.3515 | 20000 | 1.5296 | 0.0013 | 4.6161 | 2.2067 | 0.2933 | 0.6533 | 0.3764 | 0.6823 | 0.2437 | 0.6296 | 0.3826 | 0.6783 | 0.2627 | 0.6248 | 0.2715 | 0.6075 | 0.2579 | 0.6404 | 0.3646 | 0.6707 | 0.3207 | 0.6292 | 0.2926 | 0.5841 | 0.3191 | 0.6343 | 0.3784 | 0.6506 | 0.2459 | 0.6490 | 0.3313 | 0.6050 | 0.2195 | 0.6348 | 0.3329 | 0.6364 | 0.3773 | 0.2403 | 0.4597 | 0.3700 | 0.7046 | 0.6493 | 0.7398 | 0.7064 |
94
+ | 1.3324 | 90.7029 | 40000 | 1.4757 | 0.0013 | 4.3740 | 2.1290 | 0.3304 | 0.6852 | 0.4470 | 0.7163 | 0.2676 | 0.6494 | 0.4321 | 0.7014 | 0.2840 | 0.6297 | 0.2792 | 0.6112 | 0.2784 | 0.6536 | 0.3758 | 0.6853 | 0.3470 | 0.6397 | 0.2836 | 0.5838 | 0.3302 | 0.6511 | 0.3965 | 0.6604 | 0.2511 | 0.6597 | 0.3352 | 0.6558 | 0.2345 | 0.6419 | 0.0863 | 0.3805 | 0.4189 | 0.2606 | 0.4828 | 0.4033 | 0.7202 | 0.6602 | 0.7298 | 0.7267 |
95
+ | 1.263 | 136.0544 | 60000 | 1.4784 | 0.0013 | 4.3861 | 2.1329 | 0.3207 | 0.6751 | 0.4275 | 0.6999 | 0.2719 | 0.6483 | 0.4223 | 0.6899 | 0.2763 | 0.6338 | 0.2752 | 0.6014 | 0.2785 | 0.6528 | 0.3770 | 0.6798 | 0.3401 | 0.6308 | 0.3102 | 0.5725 | 0.3417 | 0.6461 | 0.3974 | 0.6600 | 0.2657 | 0.6598 | 0.2714 | 0.6686 | 0.2416 | 0.6441 | 0.3684 | 0.6782 | 0.4071 | 0.2588 | 0.4663 | 0.4118 | 0.7277 | 0.6605 | 0.7610 | 0.7240 |
96
+ | 1.1888 | 181.4059 | 80000 | 1.5073 | 0.0013 | 4.5144 | 2.1745 | 0.3370 | 0.6769 | 0.3840 | 0.6951 | 0.2663 | 0.6444 | 0.4274 | 0.6987 | 0.2671 | 0.6254 | 0.2660 | 0.5993 | 0.2703 | 0.6389 | 0.3555 | 0.6727 | 0.3440 | 0.6310 | 0.3263 | 0.5892 | 0.3298 | 0.6393 | 0.3903 | 0.6569 | 0.2676 | 0.6655 | 0.4326 | 0.6851 | 0.2449 | 0.6462 | 0.3689 | 0.6849 | 0.4143 | 0.2596 | 0.4759 | 0.3976 | 0.7280 | 0.6618 | 0.7646 | 0.7208 |
97
+ | 1.1401 | 226.7574 | 100000 | 1.5238 | 0.0013 | 4.5894 | 2.1983 | 0.3344 | 0.6828 | 0.4377 | 0.6887 | 0.2711 | 0.6473 | 0.4270 | 0.6977 | 0.2684 | 0.6173 | 0.2735 | 0.5961 | 0.2744 | 0.6365 | 0.3572 | 0.6661 | 0.3377 | 0.6224 | 0.3051 | 0.5802 | 0.3337 | 0.6383 | 0.3790 | 0.6468 | 0.2686 | 0.6594 | 0.3810 | 0.5867 | 0.2505 | 0.6458 | 0.3485 | 0.6866 | 0.4157 | 0.2553 | 0.4973 | 0.3907 | 0.7224 | 0.6580 | 0.7488 | 0.7171 |
98
+ | 1.1035 | 272.1088 | 120000 | 1.5710 | 0.0013 | 4.8115 | 2.2665 | 0.3319 | 0.6690 | 0.4017 | 0.6756 | 0.2869 | 0.6469 | 0.4084 | 0.6887 | 0.2560 | 0.6048 | 0.2697 | 0.5921 | 0.2766 | 0.6333 | 0.3519 | 0.6525 | 0.3310 | 0.6193 | 0.3101 | 0.5803 | 0.3286 | 0.6391 | 0.3974 | 0.6524 | 0.2679 | 0.6574 | 0.2611 | 0.6827 | 0.2541 | 0.6448 | 0.3777 | 0.6850 | 0.4218 | 0.2600 | 0.4547 | 0.3892 | 0.7235 | 0.6517 | 0.7486 | 0.7108 |
99
+ | 1.0732 | 317.4603 | 140000 | 1.5963 | 0.0013 | 4.9347 | 2.3030 | 0.3276 | 0.6665 | 0.4038 | 0.6610 | 0.2714 | 0.6390 | 0.3942 | 0.6810 | 0.2579 | 0.6023 | 0.2643 | 0.5904 | 0.2675 | 0.6285 | 0.3478 | 0.6483 | 0.3271 | 0.6237 | 0.3101 | 0.5817 | 0.3249 | 0.6337 | 0.3866 | 0.6459 | 0.2621 | 0.6527 | 0.2926 | 0.6842 | 0.2462 | 0.6416 | 0.3665 | 0.6823 | 0.4058 | 0.2475 | 0.4579 | 0.3821 | 0.7231 | 0.6523 | 0.7451 | 0.7062 |
100
+ | 1.0485 | 362.8118 | 160000 | 1.6166 | 0.0013 | 5.0360 | 2.3323 | 0.3348 | 0.6715 | 0.3927 | 0.6747 | 0.2878 | 0.6467 | 0.4025 | 0.6911 | 0.2556 | 0.5968 | 0.2590 | 0.5856 | 0.2668 | 0.6309 | 0.3465 | 0.6374 | 0.3375 | 0.6173 | 0.3081 | 0.5802 | 0.3263 | 0.6358 | 0.3717 | 0.6477 | 0.2698 | 0.6594 | 0.2664 | 0.6875 | 0.2537 | 0.6470 | 0.3871 | 0.6892 | 0.4088 | 0.2645 | 0.4867 | 0.3960 | 0.7259 | 0.6569 | 0.7347 | 0.7088 |
101
+ | 1.0264 | 408.1633 | 180000 | 1.6407 | 0.0013 | 5.1590 | 2.3671 | 0.3316 | 0.6720 | 0.3952 | 0.6720 | 0.2754 | 0.6424 | 0.4033 | 0.6893 | 0.2590 | 0.5971 | 0.2607 | 0.5865 | 0.2590 | 0.6276 | 0.3442 | 0.6562 | 0.3342 | 0.6176 | 0.3020 | 0.5768 | 0.3258 | 0.6388 | 0.3727 | 0.6448 | 0.2613 | 0.6539 | 0.4009 | 0.6823 | 0.2541 | 0.6432 | 0.3713 | 0.6809 | 0.4032 | 0.2569 | 0.4795 | 0.3866 | 0.7269 | 0.6555 | 0.7511 | 0.7086 |
102
+ | 1.009 | 453.5147 | 200000 | 1.6555 | 0.0013 | 5.2355 | 2.3883 | 0.3332 | 0.6727 | 0.3995 | 0.6660 | 0.2810 | 0.6403 | 0.3995 | 0.6829 | 0.2547 | 0.5907 | 0.2617 | 0.5870 | 0.2604 | 0.6271 | 0.3425 | 0.6148 | 0.3266 | 0.6156 | 0.2731 | 0.5804 | 0.3286 | 0.6367 | 0.3916 | 0.6459 | 0.2640 | 0.6591 | 0.4087 | 0.6786 | 0.2521 | 0.6460 | 0.3788 | 0.6863 | 0.4145 | 0.2634 | 0.4730 | 0.3846 | 0.7263 | 0.6556 | 0.7257 | 0.7086 |
103
 
104
 
105
  ### Framework versions
config.json CHANGED
@@ -27,5 +27,5 @@
27
  "torch_dtype": "float32",
28
  "transformers_version": "4.44.2",
29
  "use_cache": true,
30
- "vocab_size": 39
31
  }
 
27
  "torch_dtype": "float32",
28
  "transformers_version": "4.44.2",
29
  "use_cache": true,
30
+ "vocab_size": 31
31
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe74d8ebbd538360b2944bffb5f8ee45e043767da7d4cb815304e298f35fcb49
3
- size 19265856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a555fb95a12d45a694e96ce59d9cf43d69a3e5476b5d3b277ab7f23d8c179c5
3
+ size 19257664
tokenizer.json CHANGED
@@ -115,41 +115,33 @@
115
  "PAD": 1,
116
  "WORD_BOUNDARY": 2,
117
  "UTT_BOUNDARY": 3,
118
- "m": 4,
119
- "a": 5,
120
- "ɑ̃": 6,
121
- "d": 7,
122
- "ɔ": 8,
123
- "n": 9,
124
- "b": 10,
125
- "ʁ": 11,
126
- "ə": 12,
127
- "ɡ": 13,
128
- "ʒ": 14,
129
- "i": 15,
130
- "v": 16,
131
- "t": 17,
132
- "k": 18,
133
- "o": 19,
134
- "ɛ̃": 20,
135
  "w": 21,
136
- "y": 22,
137
- "j": 23,
138
- "e": 24,
139
- "ɔ̃": 25,
140
- "p": 26,
141
- "ɛ": 27,
142
- "f": 28,
143
- "s": 29,
144
- "z": 30,
145
- "l": 31,
146
- "u": 32,
147
- "ʃ": 33,
148
- "œ": 34,
149
- "ø": 35,
150
- "ɲ": 36,
151
- "t̠ʃ": 37,
152
- "d̠ʒ": 38
153
  },
154
  "unk_token": "UNK"
155
  }
 
115
  "PAD": 1,
116
  "WORD_BOUNDARY": 2,
117
  "UTT_BOUNDARY": 3,
118
+ "a": 4,
119
+ "i": 5,
120
+ "ɾ": 6,
121
+ "e̞": 7,
122
+ "n": 8,
123
+ "k": 9,
124
+ "ɲ": 10,
125
+ "o̞": 11,
126
+ "m": 12,
127
+ "s": 13,
128
+ "u": 14,
129
+ "p": 15,
130
+ "d": 16,
131
+ "l": 17,
132
+ "t": 18,
133
+ "β": 19,
134
+ "ɡ": 20,
135
  "w": 21,
136
+ "ʝ": 22,
137
+ "f": 23,
138
+ "x": 24,
139
+ "j": 25,
140
+ "r": 26,
141
+ "t̠ʃ": 27,
142
+ "ʃ": 28,
143
+ "tl": 29,
144
+ "ts": 30
 
 
 
 
 
 
 
 
145
  },
146
  "unk_token": "UNK"
147
  }
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c9f1aacd6bb9bca003a1e88dc2c07742287013b87e4849118db77562308dc4b
3
  size 5368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82b3efe1c353bf704a32a56d3e2d90a521ee074a5be0597867a8e435f00dc496
3
  size 5368
vocab.json CHANGED
@@ -1 +1 @@
1
- {"UNK":0,"PAD":1,"WORD_BOUNDARY":2,"UTT_BOUNDARY":3,"m":4,"a":5,"ɑ̃":6,"d":7,"ɔ":8,"n":9,"b":10,"ʁ":11,"ə":12,"ɡ":13,"ʒ":14,"i":15,"v":16,"t":17,"k":18,"o":19,"ɛ̃":20,"w":21,"y":22,"j":23,"e":24,"ɔ̃":25,"p":26,"ɛ":27,"f":28,"s":29,"z":30,"l":31,"u":32,"ʃ":33,"œ":34,"ø":35,"ɲ":36,"t̠ʃ":37,"d̠ʒ":38}
 
1
+ {"UNK":0,"PAD":1,"WORD_BOUNDARY":2,"UTT_BOUNDARY":3,"a":4,"i":5,"ɾ":6,"e̞":7,"n":8,"k":9,"ɲ":10,"o̞":11,"m":12,"s":13,"u":14,"p":15,"d":16,"l":17,"t":18,"β":19,"ɡ":20,"w":21,"ʝ":22,"f":23,"x":24,"j":25,"r":26,"t̠ʃ":27,"ʃ":28,"tl":29,"ts":30}