Catherine Arnett's picture

2 2 1

Catherine Arnett

catherinearnett

·

https://catherinearnett.github.io/

AI & ML interests

multilingual NLP, tokenization

Recent Activity

updated a collection about 21 hours ago

Tokenizer Training Data

updated a collection about 21 hours ago

Token Premium Monolingual Tokenizers

updated a collection about 21 hours ago

Token Premium Monolingual Tokenizers

View all activity

Articles

They Said It Couldn’t Be Done

Releasing the largest multilingual open pretraining dataset

Detoxifying the Commons

wHy DoNt YoU jUsT uSe ThE lLaMa ToKeNiZeR??

Organizations

catherinearnett's activity

updated 2 collections about 21 hours ago

Tokenizer Training Data

1GB OSCAR data for 60 languages • 14 items • Updated about 21 hours ago

Token Premium Monolingual Tokenizers

Monolingual tokenizers • 283 items • Updated about 21 hours ago