reasoning benchmark
BigCodeBench Leaderboard
BigCodeBench evaluates LLM code generation involving multiple function calls from 139 libraries and 7 domains across 1,140 fine-grained programming tasks.
Updated Sep 5, 2026
Models2
Model coverage2
MetricScore
EvidenceB
BigCodeBench Ranking
Higher score ranks better on this benchmark.
Sort by
Rank | Model | Score | Percentile | Participants | Evidence | Evaluated |
|---|
| Rank01 | ModelGO | Score45.40% | Percentile100.00% | Participants2 | EvidenceC | Evaluated |
| Rank02 | ModelAC | Score41.00% | Percentile0.00% | Participants2 | EvidenceC | Evaluated |
BigCodeBench Highlights
The leading models and scores on this benchmark.
BigCodeBench Score Distribution
A closer view of the leading scores on this benchmark.
The Top AI Models for BigCodeBench
The first five results on this benchmark, with official price and output speed added where the model identity can be matched.
What is BigCodeBench?
What BigCodeBench measures and how its scores work.
BigCodeBench is a benchmark with two variants: Complete, which uses comprehensive docstrings for code completion, and Instruct, which uses natural language instructions to generate code.
It measures code generation with diverse function calls and complex instructions using the Score metric, reported as a ratio.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- BigCodeBench
- Modality
- text
- Primary category
- reasoning
- Score direction
- higher
- LLMBoard eligible
- No
- Evaluation key
- overall
LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about BigCodeBench.
Which model scores highest on BigCodeBench?
Gemini Diffusion is currently ranked first with 45.40%.
What are the top three models on BigCodeBench?
The current leaders are Gemini Diffusion (45.40%) and Qwen2.5-Coder 7B Instruct (41.00%).
Which BigCodeBench model has the lowest official input price?
Qwen2.5-Coder 7B Instruct has the lowest matched official input price at $0.14 input / $0.29 output per 1M tokens.
Which models are fastest among BigCodeBench results?
No matched runtime record is currently available.
Does the highest score result prove overall model quality?
No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.