BigCodeArena: Judging code generations end to end with code executions
• 21
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
bigcode/the-stack
Viewer • Updated • 471M • 14.4k • 1.06k
bigcode/the-stack-v2-train-full-ids
Viewer • Updated • 58.4M • 1.07k • 63
bigcode/the-stack-v2-dedup
Viewer • Updated • 2.16B • 4.42k • 138
bigcode/the-stack-v2-train-smol-ids
Viewer • Updated • 38.9M • 2.35k • 58
bigcode/the-stack-v2
Updated • 13.1k • 615
bigcode/autocodearena-v0
Viewer • Updated • 600 • 103 • 2
bigcode/bigcodereward
Viewer • Updated • 4.73k • 103 • 2
bigcode/bigcodereward-experiment-results
Viewer • Updated • 141k • 183
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 128 • 1
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 75 • 2
bigcode/humanevalpack
Viewer • Updated • 984 • 7.2k • 92
bigcode/bigcodebench
Viewer • Updated • 5.7k • 71.9k • 86
bigcode/governance-card
Updated • 506 • 12
bigcode/bigcodebench-hard-results
Viewer • Updated • 202 • 132 • 1
bigcode/bigcodebench-hard-solve-rate
Viewer • Updated • 296 • 32 • 1
bigcode/bigcodebench-hard-domain
Viewer • Updated • 372 • 24 • 1
bigcode/bigcodebench-hard-perf
Viewer • Updated • 372 • 26
bigcode/bigcodebench-results
Viewer • Updated • 202 • 3.11k • 2
bigcode/bigcodebench-solve-rate
Viewer • Updated • 2.28k • 42
bigcode/bigcodebench-domain
Viewer • Updated • 279 • 37
bigcode/bigcodebench-perf
Viewer • Updated • 279 • 26
bigcode/starcoder2data-extras
Viewer • Updated • 51.6M • 1.69k • 13
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 11k • 3
bigcode/commitpack
Updated • 13.6k • 78
bigcode/bigcodebench-hard-elo
Viewer • Updated • 268 • 29
bigcode/bigcodebench-elo
Viewer • Updated • 222 • 35
bigcode/self-oss-instruct-sc2-exec-filter-50k
Viewer • Updated • 50.7k • 11.1k • 106
bigcode/starcoder2-instruct-assets
Viewer • Updated • 5 • 796
bigcode/MultiPL-E-completions
Viewer • Updated • 20.3k • 882 • 8
bigcode/bigcodebench-tool
Viewer • Updated • 148 • 11 • 1