added tokenizer
Browse files
TunBERT/special_tokens_map.json → special_tokens_map.json
RENAMED
File without changes
|
TunBERT/tokenizer.json → tokenizer.json
RENAMED
File without changes
|
TunBERT/tokenizer_config.json → tokenizer_config.json
RENAMED
File without changes
|
TunBERT/vocab.txt → vocab.txt
RENAMED
File without changes
|