Hugging Face's logo

Spaces:
yhavinga
/
dutch-tokenizer-arena
Running

App Files Community
1
dutch-tokenizer-arena / stats /compress_rate.json

Commit History

Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX.
c78da21

yhavinga commited on

update
f331792

xu-song commited on

add compression leaderboard
1b7fc74

xu-song commited on