gpt2-medium-indonesian / added_tokens.json
alvinwatner's picture
change endoftext value to len of tokenizer vocab size
07fc755
raw
history blame
24 Bytes
{"<|endoftext|>": 50257}