agents benchmark
Program Bench Leaderboard
Program Bench evaluates code-generation agents on recreating program behavior from a compiled binary and documentation across 200 tasks, with submissions judged against more than 248,000 fuzz-generated behavioral tests.
Updated Sep 5, 2026
Models7
Model coverage7
MetricScore
EvidenceB
Program Bench Ranking
Higher score ranks better on this benchmark.
Sort by
Rank | Model | Score | Percentile | Participants | Evidence | Evaluated |
|---|
| Rank01 | ModelMA | Score77.80% | Percentile100.00% | Participants7 | EvidenceC | Evaluated |
| Rank02 | ModelZA | Score63.70% | Percentile83.33% | Participants7 | EvidenceC | Evaluated |
| Rank03 | ModelMA | Score53.60% | Percentile66.67% | Participants7 | EvidenceC | Evaluated |
| Rank04 | ModelBY | Score50.30% | Percentile50.00% | Participants7 | EvidenceC | Evaluated |
| Rank05 | ModelBY | Score49.40% | Percentile33.33% | Participants7 | EvidenceC | Evaluated |
| Rank06 | ModelZA | Score19.00% | Percentile16.67% | Participants7 | EvidenceC | Evaluated |
| Rank07 | ModelTE | Score17.50% | Percentile0.00% | Participants7 | EvidenceC | Evaluated |
Program Bench Highlights
The leading models and scores on this benchmark.
Program Bench Score Distribution
A closer view of the leading scores on this benchmark.
The Top AI Models for Program Bench
The first five results on this benchmark, with official price and output speed added where the model identity can be matched.
What is Program Bench?
What Program Bench measures and how its scores work.
Program Bench is a benchmark for code-generation agents covering tasks ranging from small CLI tools to systems such as FFmpeg and SQLite.
It measures how well agents recreate program behavior from a compiled binary and documentation, using Score reported as a ratio against more than 248,000 fuzz-generated behavioral tests.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- Program Bench
- Modality
- text
- Primary category
- agents
- Score direction
- higher
- LLMBoard eligible
- No
- Evaluation key
- overall
LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about Program Bench.
Which model scores highest on Program Bench?
Kimi K3 is currently ranked first with 77.80%.
What are the top three models on Program Bench?
The current leaders are Kimi K3 (77.80%), GLM-5.2 (63.70%), and Kimi K2.7 Code (53.60%).
Which Program Bench model has the lowest official input price?
Kimi K2.7 Code has the lowest matched official input price at $0.95 input / $4.0 output per 1M tokens.
Which models are fastest among Program Bench results?
The fastest matched records are GLM-5.3 (472.69 tok/s via FriendliAI) and GLM-5.2 (3.96 tok/s via ZAI).
Does the highest score result prove overall model quality?
No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.