normal-model / README.md
Kyrmasch's picture
Update README.md
06ffa7b
metadata
license: openrail
datasets:
  - nthngdy/oscar-small
language:
  - kk
tags:
  - summarization
  - translation
pipeline_tag: text2text-generation

This model trains T5-V1_1-base on the Qazaq dataset of Oscar. Note that the original configuration is slightly change (dropout is set to 0).

The official run_t5_mlm_flax.py is copied into the repository and is run using the hyperparameters as defined in run_t5.sh.