jarodrigues commited on
Commit
03fc272
·
verified ·
1 Parent(s): 65d4c84

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -122,11 +122,11 @@ The base model version was evaluated on downstream tasks, namely the translation
122
  We resorted to [HyperGlue-PT](?), a **PT-PT version of the GLUE and SUPERGLUE** benchmark.
123
  We automatically translated the tasks from GLUE and SUPERGLUE using [DeepL Translate](https://www.deepl.com/), which specifically provides translation from English to PT-PT as an option.
124
 
125
- | Model | RTE (Accuracy) | WNLI (Accuracy)| MRPC (F1) | STS-B (Pearson) | COPA (Accuracy) | CB (F1) | MultiRC (F1) | BoolQ (Accuracy)
126
- |---------------------------|----------------|----------------|-----------|-----------------|-----------------|---------|--------------|
127
- | **Albertina 1.5B PT-PT** | **0.?** | 0. | **0. **| **0. ** | ? | | |
128
- | **Albertina PT-PT(900M)** | 0.8339 | 0.4225 | 0.9171 | 0.8801 | 0.7300 | 0.4739 | 0.6782 | 0.8437
129
- | **Albertina 100M PT-PT** | 0.5848 | 0.5634 | 0.8793 | 0.8624 | n.a. | 0.4734 | 0.6564 | 0.7700
130
 
131
 
132
 
 
122
  We resorted to [HyperGlue-PT](?), a **PT-PT version of the GLUE and SUPERGLUE** benchmark.
123
  We automatically translated the tasks from GLUE and SUPERGLUE using [DeepL Translate](https://www.deepl.com/), which specifically provides translation from English to PT-PT as an option.
124
 
125
+ | Model | RTE (Accuracy) | WNLI (Accuracy)| MRPC (F1) | STS-B (Pearson) | COPA (Accuracy) | CB (F1) | MultiRC (F1) | BoolQ (Accuracy) |
126
+ |---------------------------|----------------|----------------|-----------|-----------------|-----------------|---------|--------------|------------------|
127
+ | **Albertina 1.5B PT-PT** | **0.?** | 0. | **0. **| **0. ** | ? | | | |
128
+ | **Albertina PT-PT(900M)** | 0.8339 | 0.4225 | 0.9171 | 0.8801 | 0.7300 | 0.4739 | 0.6782 | 0.8437 |
129
+ | **Albertina 100M PT-PT** | 0.5848 | 0.5634 | 0.8793 | 0.8624 | n.a. | 0.4734 | 0.6564 | 0.7700 |
130
 
131
 
132