Hugging Face's logo

Spaces:
yenniejun
/
tokenizers-languages
Runtime error

App Files Community
2
tokenizers-languages

Commit History

Updating link to blog post
e7c169f

yenniejun commited on

Updating the About the Project section
96bd252

Yennie Jun commited on

Adding yaml to top of README
21a3b4f

yenniejun commited on

Merge branch 'main' of https://github.com/yenniejun/tokenizers-languages into main
7b528cd

yenniejun commited on

Adding images for README
cd2f205

yenniejun commited on

Modifying README
ac19006

yenniejun commited on

Adding license
18991e3

yenniejun commited on

Merge pull request #1 from yenniejun/yenniejun-patch-1
dc53228
unverified

yenniejun commited on

Create sync_hf_hub.yaml for syncing repo to HF
701efbc
unverified

yenniejun commited on

Rearranging some of the figures
5943f5c

yenniejun commited on

Rename text in button for refreshing
26e280e

yenniejun commited on

Adding example texts to show
62551b2

yenniejun commited on

Update explanation message and link to amazon
8641796

yenniejun commited on

Adding explanation for project
616477f

yenniejun commited on

Remove divider
fe5c81b

yenniejun commited on

Update small formatting things:
c1ad373

yenniejun commited on

Make label visibility collapsed for some options
aaff21f

yenniejun commited on

clean up the figure, add data caching, add headers
535e678

yenniejun commited on

update code to match updated data with pre-calculated token lens
29daff8

yenniejun commited on

Updating data file with tokenizer token numbers
0a9ef68

yenniejun commited on

Adding requirements
fdbf317

yenniejun commited on

rename to app.py
87987fe

yenniejun commited on

Adding main file
d0ab3b0

yenniejun commited on

Adding dataset
8a3ab6c

yenniejun commited on

initial commit
3cccf5e

yenniejun commited on