BEE-spoke-data
/

BeeTokenizer

Model card Files Files and versions Community

BeeTokenizer / special_tokens_map.json

Commit History

update tokenizer

ba51bc8
verified

pszemraj commited on Jul 20

add tk vocab size 32128

1854984

pszemraj commited on Oct 30, 2023