Nathan Brown

This collection hosts the models and datasets released as part of Pula, the first suite of LLMs for Setswana. Previously BOTS-LM.

Various efficient attention encoder-style architectures distilled into student models with half the hidden layers, plus a long-context NER dataset