dumitrescustefan
/

mt5-base-romanian

Text2Text Generation

text-generation-inference

Model card Files Files and versions Community

dumitrescustefan commited on Nov 1, 2022

Commit

96b9562

·

1 Parent(s): 948d8f4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ license: apache-2.0
 # MT5x-base-romanian
-This is a pretrained [mt5x](https://github.com/google-research/multilingual-t5) base model (390M parameters).
 Training was performed with the span corruption task on a clean 80GB Romanian text corpus for 4M total steps with these [scripts](https://github.com/dumitrescustefan/t5x_models), starting from the 1M public mt5x-base checkpoint. The model was trained with an encoder sequence length of 512 and a decoder sequence length of 256; it has the same mt5x vocabulary as the 1M multilingual checkpoint.

 # MT5x-base-romanian
+This is a pretrained [MT5](https://github.com/google-research/multilingual-t5) base model (390M parameters).
 Training was performed with the span corruption task on a clean 80GB Romanian text corpus for 4M total steps with these [scripts](https://github.com/dumitrescustefan/t5x_models), starting from the 1M public mt5x-base checkpoint. The model was trained with an encoder sequence length of 512 and a decoder sequence length of 256; it has the same mt5x vocabulary as the 1M multilingual checkpoint.