mnmt_gpt2 / added_tokens.json
Eunooeh's picture
add tokenizer
53b47ce
raw
history blame contribute delete
45 Bytes
{"<pad>": 50259, "</s>": 50257, "<s>": 50258}