Update README.md
Browse files
README.md
CHANGED
@@ -54,7 +54,7 @@ This is a <b>DeBERTa</b> <b>[1]</b> model for the <b>Italian</b> language, fine-
|
|
54 |
|
55 |
<b>Update: Version 2.0</b>
|
56 |
|
57 |
-
|
58 |
|
59 |
<h3>Training and Performances</h3>
|
60 |
|
|
|
54 |
|
55 |
<b>Update: Version 2.0</b>
|
56 |
|
57 |
+
The 2.0 version further improves the performances by exploiting a 2-phases fine-tuning strategy: the model is first fine-tuned on the English SQuAD v2 (1 epoch, 20% warmup ratio, and max learning rate of 3e-5) then further fine-tuned on the Italian SQuAD (2 epochs, no warmup, initial learning rate of 3e-5)
|
58 |
|
59 |
<h3>Training and Performances</h3>
|
60 |
|