Spaces:
Running
Running
title: Tokenizer Arena | |
emoji: ⚡ | |
colorFrom: red | |
colorTo: gray | |
sdk: gradio | |
sdk_version: 3.41.2 | |
app_file: app.py | |
pinned: false | |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference | |
## ss | |
## TODO | |
- 'MossTokenizer' object has no attribute 'encoder' | |
- chatglmTokenizer | |
## 统计 | |
https://huggingface.co/spaces/yenniejun/tokenizers-languages |