model2 / added_tokens.json
ham19za's picture
add tokenizer
cb031b0
raw
history blame contribute delete
44 Bytes
{"<|startoftext|>": 50257, "<|pad|>": 50258}