AI Energy Star Project

⭐ AI Energy Star Rating Project ⭐

🧑‍🤝‍🧑 People involved 🧑‍🤝‍🧑:

Sasha Luccioni, Boris Gamazaychikov, Emma Strubell, Sara Hooker, Yacine Jernite, Margaret Mitchell, Carole-Jean Wu

🌎 Project Mission 🌎 :

To develop an Energy Star rating system for AI model deployment that will guide members of the community in choosing models for different tasks based on energy efficiency.

⌛ Timeline (2024) ⌛:

mid-end August: project scoping and definition done early-mid September: defining testing datasets and experimental protocol done mid-late September: initial experimentation on HF cluster done early October: launch of leaderboard v1

📝 Tasks 📝:

Language:

• Text Generation
• Summarization
• Question answering (i.e. information extraction)
• Text Classification
• Sentence similarity

Vision:

• Image classification
• Object detection

Speech:

• Speech-to-text (automatic speech recognition)

Generative:

• Text to Image (Image generation)
• Image to text (Image captioning)