xu-song's picture
add more tokenizers
f4973d4
raw
history blame
21 Bytes
{
"<pad>": 32000
}