gonzalez-agirre
commited on
Commit
·
803578f
1
Parent(s):
66e9b75
Update README.md
Browse files
README.md
CHANGED
@@ -169,12 +169,13 @@ Here are the train/dev/test splits of the datasets:
|
|
169 |
|
170 |
### Evaluation Results
|
171 |
|
172 |
-
| Task | NER (F1) | POS (F1) | STS-ca (Comb) | TeCla (Acc.) |
|
173 |
| ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
|
174 |
-
| RoBERTa-
|
175 |
-
|
|
176 |
-
|
|
177 |
-
|
|
|
|
178 |
|
179 |
<sup>1</sup> : Trained on CatalanQA, tested on XQuAD-ca.
|
180 |
|
|
|
169 |
|
170 |
### Evaluation Results
|
171 |
|
172 |
+
| Task | NER (F1) | POS (F1) | STS-ca (Comb) | TeCla (Acc.) | TEca (Acc.) | VilaQuAD (F1/EM)| ViquiQuAD (F1/EM) | CatalanQA (F1/EM) | XQuAD-ca <sup>1</sup> (F1/EM) |
|
173 |
| ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
|
174 |
+
| RoBERTa-large-ca | **89.82** | **99.02** | **83.41** | **75.46** | **83.61** | **89.34**/75.50 | **89.20**/75.77 | **90.72/79.06** | **73.79**/55.34 |
|
175 |
+
| RoBERTa-base-ca-v2 | 89.29 | 98.96 | 79.07 | 74.26 | 83.14 | 87.74/72.58 | 88.72/**75.91** | 89.50/76.63 | 73.64/**55.42** |
|
176 |
+
| BERTa | 89.76 | 98.96 | 80.19 | 73.65 | 79.26 | 85.93/70.58 | 87.12/73.11 | 89.17/77.14 | 69.20/51.47 |
|
177 |
+
| mBERT | 86.87 | 98.83 | 74.26 | 69.90 | 74.63 | 82.78/67.33 | 86.89/73.53 | 86.90/74.19 | 68.79/50.80 |
|
178 |
+
| XLM-RoBERTa | 86.31 | 98.89 | 61.61 | 70.14 | 33.30 | 86.29/71.83 | 86.88/73.11 | 88.17/75.93 | 72.55/54.16 |
|
179 |
|
180 |
<sup>1</sup> : Trained on CatalanQA, tested on XQuAD-ca.
|
181 |
|