sigil-ml
/

WikipediaBPETokenizer

Model card Files Files and versions Community

WikipediaBPETokenizer

1 contributor

History: 3 commits

sdwalker62's picture

Rename bpe_tokenizer.json to tokenizer.json

37b9e7d verified about 1 month ago