openthaiGPT_finetune_LST / added_tokens.json
Norrawich's picture
Upload tokenizer
b258258
raw
history blame contribute delete
77 Bytes
{
"<|endoftext|>": 50265,
"<|pad|>": 50267,
"<|startoftext|>": 50266
}