radiogroup-crits commited on
Commit
04d5cc9
1 Parent(s): 0864ee1

evaluation results

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md CHANGED
@@ -1,3 +1,61 @@
1
  ---
 
 
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - it
4
  license: apache-2.0
5
+ tags:
6
+ - automatic-speech-recognition
7
+ - hf-asr-leaderboard
8
+ - it
9
+ - mozilla-foundation/common_voice_8_0
10
+ - robust-speech-event
11
+ datasets:
12
+ - mozilla-foundation/common_voice_8_0
13
+ model-index:
14
+ - name: XLS-R Wav2Vec2 Italian by radiogroup crits
15
+ results:
16
+ - task:
17
+ name: Automatic Speech Recognition
18
+ type: automatic-speech-recognition
19
+ dataset:
20
+ name: Common Voice 8
21
+ type: mozilla-foundation/common_voice_8_0
22
+ args: it
23
+ metrics:
24
+ - name: Test WER
25
+ type: wer
26
+ value: 9.04
27
+ - name: Test CER
28
+ type: cer
29
+ value: 2.2
30
+ - name: Test WER (+LM)
31
+ type: wer
32
+ value: 6.75
33
+ - name: Test CER (+LM)
34
+ type: cer
35
+ value: 1.76
36
  ---
37
+ # XLS-R-1B-ITALIAN-DOC4LM-5GRAM
38
+
39
+ ## Evaluation Commands
40
+
41
+ To evaluate on `mozilla-foundation/common_voice_8_0` with split `test`
42
+
43
+ ```bash
44
+ python eval.py --model_id radiogroup-crits/wav2vec2-xls-r-1b-italian-doc4lm-5gram --dataset mozilla-foundation/common_voice_8_0 --config it --split test
45
+ ```
46
+
47
+ ## Evaluation Results
48
+
49
+ metrics:
50
+ - name: Test WER
51
+ type: wer
52
+ value: 9.04
53
+ - name: Test CER
54
+ type: cer
55
+ value: 2.2
56
+ - name: Test WER (+LM)
57
+ type: wer
58
+ value: 6.75
59
+ - name: Test CER (+LM)
60
+ type: cer
61
+ value: 1.76