gpt2-medium-indonesian / added_tokens.json

Commit History

change endoftext value to len of tokenizer vocab size
07fc755

alvinwatner commited on

add tokenizers files
e7934b7

cahya commited on