Hugging Face's logo

nrshoudi
/
speech_ocean_hubert_mdd

Automatic Speech Recognition
Transformers
TensorBoard
Safetensors
hubert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
nrshoudi commited on
Commit
3b19454
•
1 Parent(s): b166a28

End of training

Browse files
Files changed (5) hide show
  1. README.md +24 -24
  2. config.json +2 -2
  3. model.safetensors +2 -2
  4. runs/Apr28_12-35-48_24d5a8fc24f1/events.out.tfevents.1714307781.24d5a8fc24f1.4804.0 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -1,8 +1,8 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: facebook/hubert-large-ll60k
6
  metrics:
7
  - wer
8
  model-index:
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [facebook/hubert-large-ll60k](https://huggingface.co/facebook/hubert-large-ll60k) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.3987
21
- - Wer: 0.5798
22
- - Cer: 0.6474
23
 
24
  ## Model description
25
 
@@ -54,26 +54,26 @@ The following hyperparameters were used during training:
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
56
  |:-------------:|:-------:|:----:|:---------------:|:------:|:------:|
57
- | 94.265 | 0.9873 | 39 | 85.1429 | 0.9995 | 0.9840 |
58
- | 52.6364 | 2.0 | 79 | 32.7798 | 1.0 | 1.0 |
59
- | 27.2435 | 2.9873 | 118 | 14.8924 | 1.0 | 1.0 |
60
- | 10.122 | 4.0 | 158 | 7.1662 | 1.0 | 1.0 |
61
- | 5.6778 | 4.9873 | 197 | 5.3731 | 1.0 | 1.0 |
62
- | 5.3058 | 6.0 | 237 | 5.2800 | 1.0 | 1.0 |
63
- | 5.3233 | 6.9873 | 276 | 5.2647 | 1.0 | 1.0 |
64
- | 5.2846 | 8.0 | 316 | 5.2266 | 1.0 | 1.0 |
65
- | 5.2555 | 8.9873 | 355 | 5.1857 | 1.0 | 1.0 |
66
- | 5.172 | 10.0 | 395 | 5.1649 | 1.0 | 1.0 |
67
- | 5.1551 | 10.9873 | 434 | 5.0741 | 1.0 | 1.0 |
68
- | 5.1312 | 12.0 | 474 | 5.0101 | 1.0 | 1.0 |
69
- | 4.9727 | 12.9873 | 513 | 4.7469 | 1.0 | 1.0 |
70
- | 4.6317 | 14.0 | 553 | 4.3717 | 0.9541 | 0.9580 |
71
- | 4.1657 | 14.9873 | 592 | 3.8313 | 0.8953 | 0.9418 |
72
- | 3.7754 | 16.0 | 632 | 3.3712 | 0.8003 | 0.8418 |
73
- | 3.3744 | 16.9873 | 671 | 2.9940 | 0.7360 | 0.8192 |
74
- | 3.0452 | 18.0 | 711 | 2.6717 | 0.6829 | 0.7675 |
75
- | 2.7951 | 18.9873 | 750 | 2.4711 | 0.6175 | 0.6972 |
76
- | 2.7407 | 19.7468 | 780 | 2.3987 | 0.5798 | 0.6474 |
77
 
78
 
79
  ### Framework versions
 
1
  ---
2
  license: apache-2.0
3
+ base_model: facebook/hubert-large-ll60k
4
  tags:
5
  - generated_from_trainer
 
6
  metrics:
7
  - wer
8
  model-index:
 
17
 
18
  This model is a fine-tuned version of [facebook/hubert-large-ll60k](https://huggingface.co/facebook/hubert-large-ll60k) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.1563
21
+ - Wer: 0.0612
22
+ - Cer: 0.0573
23
 
24
  ## Model description
25
 
 
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
56
  |:-------------:|:-------:|:----:|:---------------:|:------:|:------:|
57
+ | 24.692 | 0.9873 | 39 | 19.7376 | 0.9997 | 0.9999 |
58
+ | 6.7786 | 2.0 | 79 | 3.8382 | 1.0 | 1.0 |
59
+ | 3.77 | 2.9873 | 118 | 3.2211 | 1.0 | 1.0 |
60
+ | 3.1537 | 4.0 | 158 | 3.1178 | 1.0 | 1.0 |
61
+ | 3.0849 | 4.9873 | 197 | 3.0815 | 1.0 | 1.0 |
62
+ | 3.08 | 6.0 | 237 | 3.0583 | 1.0 | 1.0 |
63
+ | 3.0887 | 6.9873 | 276 | 3.0658 | 1.0 | 1.0 |
64
+ | 3.0528 | 8.0 | 316 | 3.0221 | 1.0 | 1.0 |
65
+ | 2.9694 | 8.9873 | 355 | 2.8183 | 1.0 | 1.0 |
66
+ | 2.6127 | 10.0 | 395 | 2.3266 | 0.9892 | 0.9935 |
67
+ | 2.0376 | 10.9873 | 434 | 1.6122 | 0.6557 | 0.6453 |
68
+ | 1.692 | 12.0 | 474 | 1.1974 | 0.4865 | 0.4708 |
69
+ | 1.245 | 12.9873 | 513 | 0.7927 | 0.2645 | 0.2425 |
70
+ | 0.9455 | 14.0 | 553 | 0.5426 | 0.1636 | 0.1371 |
71
+ | 0.7612 | 14.9873 | 592 | 0.3803 | 0.1214 | 0.1069 |
72
+ | 0.6122 | 16.0 | 632 | 0.2850 | 0.0912 | 0.0824 |
73
+ | 0.4748 | 16.9873 | 671 | 0.2247 | 0.0777 | 0.0705 |
74
+ | 0.4095 | 18.0 | 711 | 0.1796 | 0.0676 | 0.0626 |
75
+ | 0.348 | 18.9873 | 750 | 0.1623 | 0.0638 | 0.0595 |
76
+ | 0.3615 | 19.7468 | 780 | 0.1563 | 0.0612 | 0.0573 |
77
 
78
 
79
  ### Framework versions
config.json CHANGED
@@ -74,10 +74,10 @@
74
  "num_conv_pos_embeddings": 128,
75
  "num_feat_extract_layers": 7,
76
  "num_hidden_layers": 24,
77
- "pad_token_id": 1257,
78
  "tokenizer_class": "Wav2Vec2CTCTokenizer",
79
  "torch_dtype": "float32",
80
  "transformers_version": "4.40.0",
81
  "use_weighted_layer_sum": false,
82
- "vocab_size": 1260
83
  }
 
74
  "num_conv_pos_embeddings": 128,
75
  "num_feat_extract_layers": 7,
76
  "num_hidden_layers": 24,
77
+ "pad_token_id": 35,
78
  "tokenizer_class": "Wav2Vec2CTCTokenizer",
79
  "torch_dtype": "float32",
80
  "transformers_version": "4.40.0",
81
  "use_weighted_layer_sum": false,
82
+ "vocab_size": 38
83
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2aaecff40815ce2a0b73d91e7b414b2e67d89f369b3b8afba2cb5855dfc77ff5
3
- size 1266972656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:839f30502a5c1b3cc0dd20b4e9c64c15224930e1c2beb80ce1d0a1db84fb7422
3
+ size 1261962448
runs/Apr28_12-35-48_24d5a8fc24f1/events.out.tfevents.1714307781.24d5a8fc24f1.4804.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42e24503486e3a954d5d2a86821eb5a0a95bdfa5f919874c25d6c22b93c619d2
3
+ size 29868
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c39fb09aa43915c61bae83d954e67a5c5f4aeeb6c257198071a7a2689fa5be7
3
  size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bd2eccadf8560cf31c4f8cf8879edcc13bcfe49912f9d17980ecf6f1b3af115
3
  size 5048