Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
dustalov
/
wikitext-wordlevel
like
1
wikitext
English
tokenizers
tokenizer
wordlevel
wikitext
License:
cc-by-sa-3.0
Model card
Files
Files and versions
Community
main
wikitext-wordlevel
1 contributor
History:
10 commits
dustalov
Update README.md
b0f9f16
verified
9 months ago
.gitattributes
1.52 kB
initial commit
9 months ago
README.md
1.23 kB
Update README.md
9 months ago
tokenizer.json
1.81 MB
Rename wikitext-wordlevel.json to tokenizer.json
9 months ago
wikitext-wordlevel.py
1.38 kB
Upload wikitext-wordlevel.py
9 months ago