plt5-large / tokenizer_config.json
rmroczkowski's picture
First version of the plT5 Large model and tokenizer.
f0cb212
raw
history blame
141 Bytes
{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 0, "additional_special_tokens": null, "tokenizer_file": null}