-
toksuite/supertoken_models-llama_meta-llama-Llama-3.2-1B-textmatched
2B • Updated • 35 -
toksuite/supertoken_models-llama_Qwen-Qwen3-8B-textmatched
2B • Updated • 36 -
toksuite/supertoken_models-llama_common-pile-comma-v0.1-textmatched
2B • Updated • 34 -
toksuite/supertoken_models-llama_meta-llama-Llama-3.2-300M
0.6B • Updated • 57
TokSuite
community
AI & ML interests
Tokenization, Robustness, LLMs
Recent Activity
Papers
View all Papers
-
toksuite/supertoken_models-llama_google-byt5-small
Text Generation • 1B • Updated • 93 -
toksuite/supertoken_models-llama_facebook-xglm-564M
Text Generation • 2B • Updated • 76 -
toksuite/supertoken_models-llama_bigscience-bloom
Text Generation • 2B • Updated • 91 -
toksuite/supertoken_models-llama_gpt2
Text Generation • 1B • Updated • 73
-
toksuite/tokenizer_robustness_completion_stem
Viewer • Updated • 614 • 201 -
toksuite/tokenizer_robustness_completion_italian
Viewer • Updated • 1.09k • 392 -
toksuite/tokenizer_robustness_completion_english
Viewer • Updated • 1.14k • 557 -
toksuite/tokenizer_robustness_completion_math
Viewer • Updated • 189 • 340
-
toksuitebackup/Qwen-Qwen3-8B-toksuite-detokenized
Viewer • Updated • 12.8M • 273 -
toksuitebackup/aya-expanse-8b-toksuite-detokenized
Viewer • Updated • 16.8M • 297 -
toksuitebackup/comma-v0.1-toksuite-detokenized
Viewer • Updated • 13.7M • 238 -
toksuitebackup/gemma-2b-toksuite-detokenized
Viewer • Updated • 17M • 208
-
toksuite/supertoken_models-llama_meta-llama-Llama-3.2-1B-textmatched
2B • Updated • 35 -
toksuite/supertoken_models-llama_Qwen-Qwen3-8B-textmatched
2B • Updated • 36 -
toksuite/supertoken_models-llama_common-pile-comma-v0.1-textmatched
2B • Updated • 34 -
toksuite/supertoken_models-llama_meta-llama-Llama-3.2-300M
0.6B • Updated • 57
-
toksuite/tokenizer_robustness_completion_stem
Viewer • Updated • 614 • 201 -
toksuite/tokenizer_robustness_completion_italian
Viewer • Updated • 1.09k • 392 -
toksuite/tokenizer_robustness_completion_english
Viewer • Updated • 1.14k • 557 -
toksuite/tokenizer_robustness_completion_math
Viewer • Updated • 189 • 340
-
toksuite/supertoken_models-llama_google-byt5-small
Text Generation • 1B • Updated • 93 -
toksuite/supertoken_models-llama_facebook-xglm-564M
Text Generation • 2B • Updated • 76 -
toksuite/supertoken_models-llama_bigscience-bloom
Text Generation • 2B • Updated • 91 -
toksuite/supertoken_models-llama_gpt2
Text Generation • 1B • Updated • 73
-
toksuitebackup/Qwen-Qwen3-8B-toksuite-detokenized
Viewer • Updated • 12.8M • 273 -
toksuitebackup/aya-expanse-8b-toksuite-detokenized
Viewer • Updated • 16.8M • 297 -
toksuitebackup/comma-v0.1-toksuite-detokenized
Viewer • Updated • 13.7M • 238 -
toksuitebackup/gemma-2b-toksuite-detokenized
Viewer • Updated • 17M • 208