alias-gpt2-small-x21 / special_tokens_map.json
J38's picture
checkpoint-0 contents
5b48f47
raw
history blame
90 Bytes
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}