plotly_gpt_neo_1_3B / added_tokens.json
lagodw's picture
full sample tokenizer
b6c0a87
raw
history blame
48 Bytes
{"<UNK>": 50257, "<PAD>": 50259, "<SEP>": 50258}