language benchmark
Multipl-E HumanEval Leaderboard
Multipl-E HumanEval extends the HumanEval benchmark to 18 additional programming languages for evaluating neural code generation models.
Updated Sep 5, 2026
Models3
Model coverage3
MetricScore
EvidenceB
Multipl-E HumanEval Ranking
Higher score ranks better on this benchmark.
Sort by
Rank | Model | Score | Percentile | Participants | Evidence | Evaluated |
|---|
| Rank01 | ModelME | Score75.20% | Percentile100.00% | Participants3 | EvidenceC | Evaluated |
| Rank02 | ModelME | Score65.50% | Percentile50.00% | Participants3 | EvidenceC | Evaluated |
| Rank03 | ModelME | Score50.80% | Percentile0.00% | Participants3 | EvidenceC | Evaluated |
Multipl-E HumanEval Highlights
The leading models and scores on this benchmark.
Multipl-E HumanEval Score Distribution
A closer view of the leading scores on this benchmark.
The Top AI Models for Multipl-E HumanEval
The first five results on this benchmark, with official price and output speed added where the model identity can be matched.
What is Multipl-E HumanEval?
What Multipl-E HumanEval measures and how its scores work.
Multipl-E HumanEval is a benchmark that translates unit test-driven code generation tasks across multiple programming languages.
It measures code generation model performance using the Score metric, reported as a ratio, across 18 additional programming languages.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- Multipl-E HumanEval
- Modality
- text
- Primary category
- language
- Score direction
- higher
- LLMBoard eligible
- No
- Evaluation key
- overall
LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about Multipl-E HumanEval.
Which model scores highest on Multipl-E HumanEval?
Llama 3.1 405B Instruct is currently ranked first with 75.20%.
What are the top three models on Multipl-E HumanEval?
The current leaders are Llama 3.1 405B Instruct (75.20%), Llama 3.1 70B Instruct (65.50%), and Llama 3.1 8B Instruct (50.80%).
Which Multipl-E HumanEval model has the lowest official input price?
No matched official input price is currently available.
Which models are fastest among Multipl-E HumanEval results?
The fastest matched records are Llama 3.1 8B Instruct (2,047.00 tok/s via Cerebras), Llama 3.1 70B Instruct (1,204.00 tok/s via Cerebras), and Llama 3.1 405B Instruct (42.00 tok/s via Google).
Does the highest score result prove overall model quality?
No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.