FADS_base_model / added_tokens.json
10ths's picture
Upload tokenizer
131c8e6 verified
raw
history blame contribute delete
407 Bytes
{
"<image placeholder>": 32013,
"<image>": 32012,
"<pad>": 32011,
"<|assistant|>": 32001,
"<|endofchunk|>": 32014,
"<|endoftext|>": 32000,
"<|end|>": 32007,
"<|placeholder1|>": 32002,
"<|placeholder2|>": 32003,
"<|placeholder3|>": 32004,
"<|placeholder4|>": 32005,
"<|placeholder5|>": 32008,
"<|placeholder6|>": 32009,
"<|system|>": 32006,
"<|user|>": 32010
}