dumitrescustefan
commited on
Commit
·
c3212a4
1
Parent(s):
43e4430
Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ This is a pretrained-from-scratch [t5x](https://github.com/google-research/t5x)
|
|
9 |
|
10 |
Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder and decoder sequence length of 512.
|
11 |
|
12 |
-
|
13 |
|
14 |
### How to load a t5x model
|
15 |
|
|
|
9 |
|
10 |
Training was performed on a clean 80GB Romanian text corpus for 4M steps with these [scripts](https://github.com/dumitrescustefan/t5x_models). The model was trained with an encoder and decoder sequence length of 512.
|
11 |
|
12 |
+
**!! IMPORTANT !!** This model was pretrained on the span corruption MLM task, meaning this model is **not usable** in any downstream task **without finetuning** first!
|
13 |
|
14 |
### How to load a t5x model
|
15 |
|