Eyesiga commited on
Commit
264d340
1 Parent(s): f7b6e71

End of training

Browse files
README.md ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ate
4
+ license: apache-2.0
5
+ base_model: openai/whisper-base
6
+ tags:
7
+ - whisper-event
8
+ - generated_from_trainer
9
+ datasets:
10
+ - tericlabs
11
+ metrics:
12
+ - wer
13
+ model-index:
14
+ - name: Whisper base ateso
15
+ results:
16
+ - task:
17
+ name: Automatic Speech Recognition
18
+ type: automatic-speech-recognition
19
+ dataset:
20
+ name: Sunbird
21
+ type: tericlabs
22
+ metrics:
23
+ - name: Wer
24
+ type: wer
25
+ value: 27.710843373493976
26
+ ---
27
+
28
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
29
+ should probably proofread and complete it, then remove this comment. -->
30
+
31
+ # Whisper base ateso
32
+
33
+ This model is a fine-tuned version of [openai/whisper-base](https://huggingface.co/openai/whisper-base) on the Sunbird dataset.
34
+ It achieves the following results on the evaluation set:
35
+ - Loss: 0.5293
36
+ - Wer: 27.7108
37
+
38
+ ## Model description
39
+
40
+ More information needed
41
+
42
+ ## Intended uses & limitations
43
+
44
+ More information needed
45
+
46
+ ## Training and evaluation data
47
+
48
+ More information needed
49
+
50
+ ## Training procedure
51
+
52
+ ### Training hyperparameters
53
+
54
+ The following hyperparameters were used during training:
55
+ - learning_rate: 1e-05
56
+ - train_batch_size: 16
57
+ - eval_batch_size: 8
58
+ - seed: 42
59
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
+ - lr_scheduler_type: linear
61
+ - lr_scheduler_warmup_steps: 1000
62
+ - training_steps: 5000
63
+ - mixed_precision_training: Native AMP
64
+
65
+ ### Training results
66
+
67
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
68
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|
69
+ | 0.4597 | 3.5 | 1000 | 0.5186 | 32.1285 |
70
+ | 0.1812 | 6.99 | 2000 | 0.4394 | 26.7738 |
71
+ | 0.0429 | 10.49 | 3000 | 0.4765 | 26.7738 |
72
+ | 0.016 | 13.99 | 4000 | 0.5157 | 27.3092 |
73
+ | 0.0053 | 17.48 | 5000 | 0.5293 | 27.7108 |
74
+
75
+
76
+ ### Framework versions
77
+
78
+ - Transformers 4.38.0.dev0
79
+ - Pytorch 2.1.0+cu121
80
+ - Datasets 2.17.1
81
+ - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:15cb7fec78addd3cdca0548f6d6f9d89079c20d26054849f72e1ff40b59c3f30
3
  size 290401888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dafb8819bf88466877db7917800ed46f1e28ac63d755e8e767f6d057210c4bc9
3
  size 290401888
runs/Feb19_11-35-18_77e1f16dfc77/events.out.tfevents.1708342529.77e1f16dfc77.3359.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a4cf471fc2b606396e94f861909fdf72be6bfb32bdc01588f593cd1685307e16
3
- size 39293
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7ababb6505ee81f1721f75932d858d5da78653d6d1677959ad7ac1c6de11cdc
3
+ size 39647