sail
/

scaling-with-vocab-trained-tokenizers

Model card Files Files and versions

scaling-with-vocab-trained-tokenizers / hf_slimpajama-6B-4096-BPE

300 kB

1 contributor

History: 1 commit

tcftrees's picture

Upload folder using huggingface_hub

bdb9681 verified over 1 year ago

special_tokens_map.json

411 Bytes

Upload folder using huggingface_hub over 1 year ago
tokenizer.model

299 kB
xet

Upload folder using huggingface_hub over 1 year ago
tokenizer_config.json

746 Bytes

Upload folder using huggingface_hub over 1 year ago