Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

yhavinga
/

dutch-tokenizer-arena

Running

App Files Files Community

dutch-tokenizer-arena

3 contributors

History: 61 commits

xu-song's picture

add character glm

f0f84b2 10 months ago

css
update over 1 year ago
images
update over 1 year ago
js
fix chatglm; new feature about add_special_tokens; 11 months ago
tokenizer
update 10 months ago
utils
add more tokenizer 11 months ago
vocab
add character glm 10 months ago
.gitattributes

1.83 kB

add gemma_7b 10 months ago
.gitignore

171 Bytes

update over 1 year ago
README.md

330 Bytes

update 11 months ago
app.py

7.08 kB

update 10 months ago
config.py

45 Bytes

fix chatglm; new feature about add_special_tokens; 11 months ago
evaluation.md

58 Bytes

update over 1 year ago
examples.py

2.93 kB

update 10 months ago
requirements.txt

72 Bytes

add olmo tokenizer 10 months ago
util.py

6.22 kB

fix tiktoken 10 months ago