Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
xu-song
/
tokenizer-arena
like
56
Running
App
Files
Files
Community
1
057bc67
tokenizer-arena
/
vocab
/
baichuan
/
Baichuan-7B
2 contributors
History:
2 commits
xu-song
add more tokenizers
f4973d4
11 months ago
config.json
Safe
656 Bytes
update
about 1 year ago
configuration_baichuan.py
Safe
2.35 kB
update
about 1 year ago
special_tokens_map.json
Safe
411 Bytes
update
about 1 year ago
tokenization_baichuan.py
Safe
9.57 kB
add more tokenizers
11 months ago
tokenizer.model
Safe
1.14 MB
LFS
update
about 1 year ago
tokenizer_config.json
Safe
802 Bytes
update
about 1 year ago