jarodrigues commited on
Commit
40305be
1 Parent(s): 2143e61

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -142,7 +142,7 @@ This involves repurposing the tasks in various ways, such as generation of answe
142
  | **LLaMA 2 Chat** | 0.5432 | 0.3807 | **0.5493**|
143
  <br>
144
 
145
- For further testing our decoder, in addition to the testing data described above, we also reused some of the datasets that had been resorted for American Portuguese to test the state-of-the-art Sabiá model and that were originally developed with materials from Portuguese: ASSIN2 RTE (entailment) and ASSIN2 STS (similarity), BLUEX (question answering), ENEM~2022 (question answering) and FaQuAD (extractive question-answering).
146
 
147
  The scores of Sabiá invite to contrast them with Gervásio's but such comparison needs to be taken with some caution.
148
  - First, these are a repetition of the scores presented in the respective paper, which only provide results for a single run of each task, while scores of Gervásio are the average of three runs, with different seeds.
 
142
  | **LLaMA 2 Chat** | 0.5432 | 0.3807 | **0.5493**|
143
  <br>
144
 
145
+ For further testing our decoder, in addition to the testing data described above, we also reused some of the datasets that had been resorted for American Portuguese to test the state-of-the-art Sabiá model and that were originally developed with materials from Portuguese: ASSIN2 RTE (entailment) and ASSIN2 STS (similarity), BLUEX (question answering), ENEM 2022 (question answering) and FaQuAD (extractive question-answering).
146
 
147
  The scores of Sabiá invite to contrast them with Gervásio's but such comparison needs to be taken with some caution.
148
  - First, these are a repetition of the scores presented in the respective paper, which only provide results for a single run of each task, while scores of Gervásio are the average of three runs, with different seeds.