programbench/20260815_mini-v2.4.2_gemini-3-7-flash
Viewer • Updated • 1 • 274
ProgramBench
university
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
ProgramBench: Can Language Models Rebuild Programs From Scratch?
Given only a compiled binary and its documentation, AI agents must architect and implement a complete codebase that reproduces the original program's behavior. ProgramBench evaluates this capability across 200 real-world open-source projects spanning Rust, Go, C, C++, Haskell, and Java.
Links
models 0
None public yet
datasets 22
programbench/20260730_mini-v2.2.8_gpt-5-6-sol
Viewer • Updated • 1 • 81
programbench/20260802_mini-v2.4.2_gpt-5-6-sol-xhigh
Viewer • Updated • 1 • 93
programbench/20260731_mini-v2.4.2_opus-5-xhigh
Viewer • Updated • 1 • 103
programbench/20260731_mini-v2.4.2_gemini-3-6-flash
Viewer • Updated • 1 • 79
programbench/20260729_mini-v2.2.8_gemini-3-5-flash
Viewer • Updated • 1 • 78
programbench/20260507_mini-v2.2.6_opus-4-7-xhigh
Viewer • Updated • 1 • 95
programbench/20260717_mini-v2.4.5_opus-4.8-xhigh
Viewer • Updated • 1 • 370
programbench/20260717_mini-v2.4.5_glm-5.2
Viewer • Updated • 1 • 974
programbench/20260508_mini-v2.2.6_gpt-5-5-xhigh
Viewer • Updated • 1 • 147