Sara Hooker's picture

Sara Hooker

sarahooker

·

https://www.sarahooker.me/

AI & ML interests

None yet

Recent Activity

liked a model 8 days ago

CohereForAI/c4ai-command-r7b-12-2024

liked a dataset 9 days ago

CohereForAI/Global-MMLU-Lite

reacted to dvilasuero's post with ❤️ 17 days ago

🌐 Announcing Global-MMLU: an improved MMLU Open dataset with evaluation coverage across 42 languages, built with Argilla and the Hugging Face community. Global-MMLU is the result of months of work with the goal of advancing Multilingual LLM evaluation. It's been an amazing open science effort with collaborators from Cohere For AI, Mila - Quebec Artificial Intelligence Institute, EPFL, Massachusetts Institute of Technology, AI Singapore, National University of Singapore, KAIST, Instituto Superior Técnico, Carnegie Mellon University, CONICET, and University of Buenos Aires. 🏷️ +200 contributors used Argilla MMLU questions where regional, dialect, or cultural knowledge was required to answer correctly. 85% of the questions required Western-centric knowledge! Thanks to this annotation process, the open dataset contains two subsets: 1. 🗽 Culturally Agnostic: no specific regional, cultural knowledge is required. 2. ⚖️ Culturally Sensitive: requires dialect, cultural knowledge or geographic knowledge to answer correctly. Moreover, we provide high quality translations of 25 out of 42 languages, thanks again to the community and professional annotators leveraging Argilla on the Hub. I hope this will ensure a better understanding of the limitations and challenges for making open AI useful for many languages. Dataset: https://huggingface.co/datasets/CohereForAI/Global-MMLU

View all activity

Organizations

sarahooker's activity

New activity in CohereForAI/c4ai-command-r-plus 9 months ago

Update README.md

#10 opened 9 months ago by

New activity in CohereForAI/c4ai-command 9 months ago

дай ссылки на эти сервисы

#6 opened 9 months ago by

Snake game

#4 opened 9 months ago by

Biilionaire killers

#9 opened 9 months ago by

billionaires ruling the world

#10 opened 9 months ago by

Kim Jong Un Daughter

#11 opened 9 months ago by

Female Rappers Scandals

#5 opened 9 months ago by

JT did this live

#12 opened 9 months ago by

Vladimir Putin is Richer Than You Think

#13 opened 9 months ago by

wild female rappers

#14 opened 9 months ago by

men who killed rappers

#15 opened 9 months ago by

Update app.py

#8 opened 9 months ago by

New activity in CohereForAI/c4ai-command-r-plus 9 months ago

MMLU is only 25.64, anything wrong?

#8 opened 9 months ago by

Quantized models (4bit) request

#4 opened 9 months ago by

Question about license

#2 opened 9 months ago by

New activity in CohereForAI/c4ai-command 9 months ago

Update app.py

#1 opened 9 months ago by

New activity in CohereForAI/c4ai-command-r-v01 9 months ago

TypeError: AttentionMaskConverter._unmask_unattended() missing 1 required positional argument: 'unmasked_value'

#13 opened 10 months ago by

Run Command-R on CPU

#19 opened 10 months ago by

ValueError: Unrecognized configuration class

#42 opened 9 months ago by

Remove AutoConfig, AutoModel and AutoModelForCausalLM register

#37 opened 9 months ago by