SaeedRahmani
/

fa-tokenizer

Model card Files Files and versions Community

fa-tokenizer / wiki

1 contributor

History: 3 commits

SaeedRahmani's picture

Upload /wiki/tokenizer_wiki_10k.json with huggingface_hub

1decb50 verified about 1 year ago

tokenizer_wiki_100k.json

1.8 MB

Upload /wiki/tokenizer_wiki_100k.json with huggingface_hub about 1 year ago
tokenizer_wiki_10k.json

314 kB

Upload /wiki/tokenizer_wiki_10k.json with huggingface_hub about 1 year ago
tokenizer_wiki_1m.json

1.79 MB

Upload /wiki/tokenizer_wiki_1m.json with huggingface_hub about 1 year ago