CodeGPT-small-py / added_tokens.json
claudios's picture
Upload tokenizer
42c7920 verified
raw
history blame contribute delete
45 Bytes
{
"<EOL>": 50000,
"<|UNKNOWN|>": 50001
}