SmolLM2-135M / added_tokens.json
danielhanchen's picture
Upload tokenizer
f7bc5b1 verified
raw
history blame
29 Bytes
{
"<|PAD_TOKEN|>": 49152
}