KELIP / special_tokens_map.json
Geonmo's picture
add tokenizer
027d7a6
raw
history blame
44 Bytes
{"bos_token": "[SOT]", "eos_token": "[EOT]"}