MLGym: A New Framework and Benchmark for Advancing AI Research Agents
Paper
•
2502.14499
•
Published
•
139
Grégoire Mialon
gregmialz
AI & ML interests
Self-supervised learning, Augmented LLMs
Recent Activity
upvoted
a
paper
1 day ago
MLGym: A New Framework and Benchmark for Advancing AI Research Agents
liked
a Space
8 months ago
Nexusflow/Nexus_Function_Calling_Leaderboard
liked
a Space
11 months ago
gaia-benchmark/leaderboard
Organizations
gregmialz's activity
upvoted
a
paper
1 day ago
liked
a
Space
8 months ago
liked
a
Space
11 months ago
liked
2
datasets
12 months ago
where is the score function?
2
#3 opened about 1 year ago
by
eyuansu71
upvoted
a
paper
about 1 year ago
Possible future contamination problem
3
#7 opened about 1 year ago
by
supercharge19
reacted to
clefourrier's
post with 🤗
about 1 year ago
Post
🏅 New top model on the GAIA benchmark!
Called FRIDAY, it's a mysterious new autonomous agent, which got quite good performances on both the public validation set *and* the private test set.
It notably passed 10 points for the val and 5 points for the test set on our hardest questions (level 3): they require to take arbitrarily long sequences of actions, use any number of tools, and access the world in genera! ✨
The GAIA benchmark evaluates next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc) and was co authored by @gregmialz @ThomasNLG @ylecun @thomwolf and myself: gaia-benchmark/leaderboard
Called FRIDAY, it's a mysterious new autonomous agent, which got quite good performances on both the public validation set *and* the private test set.
It notably passed 10 points for the val and 5 points for the test set on our hardest questions (level 3): they require to take arbitrarily long sequences of actions, use any number of tools, and access the world in genera! ✨
The GAIA benchmark evaluates next-generation LLMs (LLMs with augmented capabilities due to added tooling, efficient prompting, access to search, etc) and was co authored by @gregmialz @ThomasNLG @ylecun @thomwolf and myself: gaia-benchmark/leaderboard
- 5 replies
Removing Duplicate Submission Records
8
#5 opened about 1 year ago
by
hccngu
commented
2
papers
about 1 year ago
authored
a
paper
about 1 year ago
upvoted
a
paper
about 1 year ago
Update scorer.py
#1 opened over 1 year ago
by
gregmialz