agnesluhtaru commited on
Commit
8053744
2 Parent(s): 1bae198 0a309ab

Merge branch 'main' of https://huggingface.co/agnesluhtaru/whisper-large-et-clinic

Browse files
Files changed (1) hide show
  1. README.md +0 -66
README.md DELETED
@@ -1,66 +0,0 @@
1
- ---
2
- license: apache-2.0
3
- tags:
4
- - generated_from_trainer
5
- metrics:
6
- - wer
7
- model-index:
8
- - name: whisper-large-et-clinic
9
- results: []
10
- ---
11
-
12
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
- should probably proofread and complete it, then remove this comment. -->
14
-
15
- # whisper-large-et-clinic
16
-
17
- This model is a fine-tuned version of [agnesluhtaru/whisper-large-et-ERR2020-v2](https://huggingface.co/agnesluhtaru/whisper-large-et-ERR2020-v2) on an unknown dataset.
18
- It achieves the following results on the evaluation set:
19
- - Loss: 0.3862
20
- - Wer: 15.5413
21
-
22
- ## Model description
23
-
24
- More information needed
25
-
26
- ## Intended uses & limitations
27
-
28
- More information needed
29
-
30
- ## Training and evaluation data
31
-
32
- More information needed
33
-
34
- ## Training procedure
35
-
36
- ### Training hyperparameters
37
-
38
- The following hyperparameters were used during training:
39
- - learning_rate: 1e-05
40
- - train_batch_size: 2
41
- - eval_batch_size: 1
42
- - seed: 42
43
- - gradient_accumulation_steps: 16
44
- - total_train_batch_size: 32
45
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
- - lr_scheduler_type: linear
47
- - lr_scheduler_warmup_steps: 200
48
- - training_steps: 2000
49
- - mixed_precision_training: Native AMP
50
-
51
- ### Training results
52
-
53
- | Training Loss | Epoch | Step | Validation Loss | Wer |
54
- |:-------------:|:-----:|:----:|:---------------:|:-------:|
55
- | 0.0278 | 4.03 | 500 | 0.2986 | 16.9940 |
56
- | 0.0037 | 8.06 | 1000 | 0.3383 | 16.1774 |
57
- | 0.0017 | 12.1 | 1500 | 0.3619 | 15.8035 |
58
- | 0.0008 | 16.13 | 2000 | 0.3862 | 15.5413 |
59
-
60
-
61
- ### Framework versions
62
-
63
- - Transformers 4.26.0.dev0
64
- - Pytorch 1.12.1+rocm5.1.1
65
- - Datasets 2.7.1.dev0
66
- - Tokenizers 0.13.2