BigCodeArena: Judging code generations end to end with code executions
• 21
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
Unveiling More Reliable Human Preferences in Code Generation via Execution
-
BigCodeArena
🚀37Compare two AI models by sending them code and seeing their responses
-
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Paper • 2510.08697 • Published • 40 -
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 88 • 2 -
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 81 • 1
All models, datasets, and demos related to StarCoder!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
BigCodeBench Leaderboard
🥇232Explore code-generation model leaderboards and task details
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 50 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 51.1k • 86 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 12.6k • 3
Models based on either StarCoder or The Stack!
Unveiling More Reliable Human Preferences in Code Generation via Execution
-
BigCodeArena
🚀37Compare two AI models by sending them code and seeing their responses
-
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Paper • 2510.08697 • Published • 40 -
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 88 • 2 -
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 81 • 1
StarCoder2 models and datasets!
All models, datasets, and demos related to StarCoder!
Datasets and spaces related to The Stack!
Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
https://bigcode-bench.github.io/
-
BigCodeBench Leaderboard
🥇232Explore code-generation model leaderboards and task details
-
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Paper • 2406.15877 • Published • 50 -
bigcode/bigcodebench
Viewer • Updated • 5.7k • 51.1k • 86 -
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 12.6k • 3
Models based on either StarCoder or The Stack!