esm2_t33_650M_UR50D / added_tokens.json
ArmelRandy's picture
Upload tokenizer
b9e7f3c
raw
history blame contribute delete
75 Bytes
{
"<cls>": 0,
"<eos>": 2,
"<mask>": 32,
"<pad>": 1,
"<unk>": 3
}