nband's picture
Upload tokenizer
34efc1b verified
raw
history blame contribute delete
39 Bytes
{
"<pad>": 32000,
"[PAD]": 32001
}