32
Long Code Arena
🏟
Display leaderboard results for coding tasks
🏟️ Long Code Arena
All the resources for our Long Code Arena benchmark!
Note Long Code Arena leaderboard.
JetBrains-Research/lca-results
Viewer • Updated • 94 • 451Note Raw results from Long Code Arena leaderboard, as well as models' predictions.
JetBrains-Research/lca-commit-message-generation
Viewer • Updated • 2.81k • 199Note Dataset for Commit Message Generation task.
JetBrains-Research/lca-bug-localization
Viewer • Updated • 15k • 843 • 1Note Dataset for Bug Localization task.
JetBrains-Research/lca-ci-builds-repair
Viewer • Updated • 212 • 130Note Dataset for CI Builds Repair task.
JetBrains-Research/lca-module-summarization
Viewer • Updated • 216 • 121Note Dataset for Module Summarization task.
JetBrains-Research/lca-library-based-code-generation
Viewer • Updated • 150 • 177 • 1Note Dataset for Library-Based Code Generation task.
JetBrains-Research/lca-project-level-code-completion
Viewer • Updated • 908 • 467Note Dataset for Project-Level Code Completion task.
Long Code Arena: a Set of Benchmarks for Long-Context Code Models
Paper • 2406.11612 • Published • 25Note Original Paper