Commit
·
4137579
1
Parent(s):
d754ae4
Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@ license: apache-2.0
|
|
| 6 |
|
| 7 |
# T5x-base-romanian
|
| 8 |
|
| 9 |
-
This is a pretrained-from-scratch [t5x](https://github.com/google-research/t5x)
|
| 10 |
|
| 11 |
Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder sequence length of 512 and a decoder sequence length of 256.
|
| 12 |
|
|
|
|
| 6 |
|
| 7 |
# T5x-base-romanian
|
| 8 |
|
| 9 |
+
This is a pretrained-from-scratch T5v1.1 base model (247M parameters) on the [t5x](https://github.com/google-research/t5x) platform.
|
| 10 |
|
| 11 |
Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder sequence length of 512 and a decoder sequence length of 256.
|
| 12 |
|