gonzalez-agirre commited on
Commit
803578f
·
1 Parent(s): 66e9b75

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -169,12 +169,13 @@ Here are the train/dev/test splits of the datasets:
169
 
170
  ### Evaluation Results
171
 
172
- | Task | NER (F1) | POS (F1) | STS-ca (Comb) | TeCla (Acc.) | TE-ca (Acc.) | VilaQuAD (F1/EM)| ViquiQuAD (F1/EM) | CatalanQA (F1/EM) | XQuAD-ca <sup>1</sup> (F1/EM) |
173
  | ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
174
- | RoBERTa-base-ca-v2 | **89.45** | 99.09 | 79.07 | **74.26** | **83.14** | **87.74/72.58** | **88.72/75.91** | **89.50**/76.63 | **73.64/55.42** |
175
- | BERTa | 88.94 | **99.10** | **80.19** | 73.65 | 79.26 | 85.93/70.58 | 87.12/73.11 | 89.17/**77.14** | 69.20/51.47 |
176
- | mBERT | 87.36 | 98.98 | 74.26 | 69.90 | 74.63 | 82.78/67.33 | 86.89/73.53 | 86.90/74.19 | 68.79/50.80 |
177
- | XLM-RoBERTa | 88.07 | 99.03 | 61.61 | 70.14 | 33.30 | 86.29/71.83 | 86.88/73.11 | 88.17/75.93 | 72.55/54.16 |
 
178
 
179
  <sup>1</sup> : Trained on CatalanQA, tested on XQuAD-ca.
180
 
 
169
 
170
  ### Evaluation Results
171
 
172
+ | Task | NER (F1) | POS (F1) | STS-ca (Comb) | TeCla (Acc.) | TEca (Acc.) | VilaQuAD (F1/EM)| ViquiQuAD (F1/EM) | CatalanQA (F1/EM) | XQuAD-ca <sup>1</sup> (F1/EM) |
173
  | ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
174
+ | RoBERTa-large-ca | **89.82** | **99.02** | **83.41** | **75.46** | **83.61** | **89.34**/75.50 | **89.20**/75.77 | **90.72/79.06** | **73.79**/55.34 |
175
+ | RoBERTa-base-ca-v2 | 89.29 | 98.96 | 79.07 | 74.26 | 83.14 | 87.74/72.58 | 88.72/**75.91** | 89.50/76.63 | 73.64/**55.42** |
176
+ | BERTa | 89.76 | 98.96 | 80.19 | 73.65 | 79.26 | 85.93/70.58 | 87.12/73.11 | 89.17/77.14 | 69.20/51.47 |
177
+ | mBERT | 86.87 | 98.83 | 74.26 | 69.90 | 74.63 | 82.78/67.33 | 86.89/73.53 | 86.90/74.19 | 68.79/50.80 |
178
+ | XLM-RoBERTa | 86.31 | 98.89 | 61.61 | 70.14 | 33.30 | 86.29/71.83 | 86.88/73.11 | 88.17/75.93 | 72.55/54.16 |
179
 
180
  <sup>1</sup> : Trained on CatalanQA, tested on XQuAD-ca.
181