programbench/20260918_mini-v2.4.5_muse-spark-1.3-max
Updated • 14
ProgramBench
university
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
ProgramBench: Can Language Models Rebuild Programs From Scratch?
Given only a compiled binary and its documentation, AI agents must architect and implement a complete codebase that reproduces the original program's behavior. ProgramBench evaluates this capability across 200 real-world open-source projects spanning Rust, Go, C, C++, Haskell, and Java.
Links
models 0
None public yet
datasets 26
programbench/20260910_mini-v2.4.5_muse-spark-1.3-xhigh
Updated • 9
programbench/20260906_mini-v2.4.2_muse-spark-1.1-xhigh
Viewer • Updated • 1 • 9
programbench/20260908_mini-v2.4.2_muse-spark-1.2-xhigh
Viewer • Updated • 1 • 86
programbench/20260815_mini-v2.4.2_gemini-3-7-flash
Viewer • Updated • 1 • 149
programbench/20260730_mini-v2.2.8_gpt-5-6-sol
Viewer • Updated • 1 • 316
programbench/20260802_mini-v2.4.2_gpt-5-6-sol-xhigh
Viewer • Updated • 1 • 412
programbench/20260731_mini-v2.4.2_opus-5-xhigh
Viewer • Updated • 1 • 455
programbench/20260731_mini-v2.4.2_gemini-3-6-flash
Viewer • Updated • 1 • 374
programbench/20260729_mini-v2.2.8_gemini-3-5-flash
Viewer • Updated • 1 • 266