Catherine Arnett's picture

2 2 1

Catherine Arnett

catherinearnett

·

https://catherinearnett.github.io/

AI & ML interests

multilingual NLP, tokenization

Recent Activity

updated a collection about 18 hours ago

Tokenizer Training Data

updated a collection about 18 hours ago

Token Premium Monolingual Tokenizers

updated a collection about 18 hours ago

Token Premium Monolingual Tokenizers

View all activity

Articles

They Said It Couldn’t Be Done

Releasing the largest multilingual open pretraining dataset

Detoxifying the Commons

wHy DoNt YoU jUsT uSe ThE lLaMa ToKeNiZeR??

Organizations

Collections 1

Papers 7

arxiv:2410.22587

arxiv:2409.04599

arxiv:2408.10441

arxiv:2403.13754

models 16

catherinearnett/B-GPT_pl_en_sequential

Text Generation • Updated Sep 26, 2024 • 50

catherinearnett/B-GPT_en_pl_sequential

Text Generation • Updated Sep 26, 2024 • 48

catherinearnett/B-GPT_pl_en_simultaneous

Text Generation • Updated Sep 26, 2024 • 47

catherinearnett/B-GPT_en_pl_simultaneous

Text Generation • Updated Sep 26, 2024 • 48

catherinearnett/B-GPT_el_en_sequential

Text Generation • Updated Sep 26, 2024 • 47

catherinearnett/B-GPT_el_en_simultaneous

Text Generation • Updated Sep 26, 2024 • 43

catherinearnett/B-GPT_en_el_sequential

Text Generation • Updated Sep 26, 2024 • 51

catherinearnett/B-GPT_en_el_simultaneous

Text Generation • Updated Sep 26, 2024 • 44

catherinearnett/B-GPT_en_es_sequential

Text Generation • Updated Sep 26, 2024 • 43

catherinearnett/B-GPT_es_en_sequential

Text Generation • Updated Sep 26, 2024 • 44

datasets

None public yet