reasoning benchmark
SWE-bench Multilingual Leaderboard
SWE-bench Multilingual is a multilingual software engineering benchmark covering Java, TypeScript, JavaScript, Go, Rust, C, and C++.
Updated Oct 23, 2026
Models50
Model coverage50
MetricScore
EvidenceB
SWE-bench Multilingual Ranking
Higher score ranks better on this benchmark.
Sort by
Rank | Model | Score | Percentile | Participants | Evidence | Evaluated |
|---|
| Rank01 | ModelAN | Score93.90% | Percentile100.00% | Participants50 | EvidenceC | Evaluated |
| Rank02 | ModelAN | Score90.30% | Percentile97.96% | Participants50 | EvidenceC | Evaluated |
| Rank03 | ModelAN | Score87.30% | Percentile95.92% | Participants50 | EvidenceC | Evaluated |
| Rank04 | ModelAN | Score84.40% | Percentile93.88% | Participants50 | EvidenceC | Evaluated |
| Rank05 | ModelAN | Score83.70% | Percentile91.84% | Participants50 | EvidenceC | Evaluated |
| Rank06 | ModelTE | Score82.90% | Percentile89.80% | Participants50 | EvidenceC | Evaluated |
| Rank07 | ModelAC | Score81.00% | Percentile87.76% | Participants50 | EvidenceC | Evaluated |
| Rank08 | ModelAC | Score81.00% | Percentile85.71% | Participants50 | EvidenceC | Evaluated |
| Rank09 | ModelPO | Score78.50% | Percentile83.67% | Participants50 | EvidenceC | Evaluated |
| Rank10 | ModelAN | Score78.30% | Percentile81.63% | Participants50 | EvidenceC | Evaluated |
| Rank11 | ModelAC | Score78.30% | Percentile79.59% | Participants50 | EvidenceC | Evaluated |
| Rank12 | ModelRA | Score78.30% | Percentile77.55% | Participants50 | EvidenceC | Evaluated |
| Rank13 | ModelAN | Score77.83% | Percentile75.51% | Participants50 | EvidenceC | Evaluated |
| Rank14 | ModelMA | Score76.70% | Percentile73.47% | Participants50 | EvidenceC | Evaluated |
| Rank15 | ModelMI | Score76.50% | Percentile71.43% | Participants50 | EvidenceC | Evaluated |
| Rank16 | ModelDE | Score76.20% | Percentile69.39% | Participants50 | EvidenceC | Evaluated |
| Rank17 | ModelTE | Score75.80% | Percentile67.35% | Participants50 | EvidenceC | Evaluated |
| Rank18 | ModelAC | Score75.80% | Percentile65.31% | Participants50 | EvidenceC | Evaluated |
| Rank19 | ModelAC | Score73.80% | Percentile63.27% | Participants50 | EvidenceC | Evaluated |
| Rank20 | ModelDE | Score73.30% | Percentile61.22% | Participants50 | EvidenceC | Evaluated |
| Rank21 | ModelMA | Score73.00% | Percentile59.18% | Participants50 | EvidenceC | Evaluated |
| Rank22 | ModelMI | Score72.50% | Percentile57.14% | Participants50 | EvidenceC | Evaluated |
| Rank23 | ModelIN | Score72.40% | Percentile55.10% | Participants50 | EvidenceC | Evaluated |
| Rank24 | ModelXI | Score71.70% | Percentile53.06% | Participants50 | EvidenceC | Evaluated |
| Rank25 | ModelXI | Score71.70% | Percentile51.02% | Participants50 | EvidenceC | Evaluated |
| Rank26 | ModelAC | Score71.30% | Percentile48.98% | Participants50 | EvidenceC | Evaluated |
| Rank27 | ModelDE | Score70.20% | Percentile46.94% | Participants50 | EvidenceC | Evaluated |
| Rank28 | ModelDE | Score70.20% | Percentile44.90% | Participants50 | EvidenceC | Evaluated |
| Rank29 | ModelDE | Score70.20% | Percentile42.86% | Participants50 | EvidenceC | Evaluated |
| Rank30 | ModelAC | Score69.30% | Percentile40.82% | Participants50 | EvidenceC | Evaluated |
SWE-bench Multilingual Highlights
The leading models and scores on this benchmark.
SWE-bench Multilingual Score Distribution
A closer view of the leading scores on this benchmark.
The Top AI Models for SWE-bench Multilingual
The first five results on this benchmark, with official price and output speed added where the model identity can be matched.
What is SWE-bench Multilingual?
What SWE-bench Multilingual measures and how its scores work.
SWE-bench Multilingual contains 1,632 instances annotated from 2,456 candidates by 68 expert annotators to evaluate Large Language Models across diverse software ecosystems beyond Python.
It measures issue resolving in software engineering using the Score metric, reported as a ratio.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- SWE-bench Multilingual
- Modality
- text
- Primary category
- reasoning
- Score direction
- higher
- LLMBoard eligible
- No
- Evaluation key
- overall
LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about SWE-bench Multilingual.
Which model scores highest on SWE-bench Multilingual?
Claude Opus 5.5 is currently ranked first with 93.90%.
What are the top three models on SWE-bench Multilingual?
The current leaders are Claude Opus 5.5 (93.90%), Claude Sonnet 5.5 (90.30%), and Claude Mythos Preview (87.30%).
Which SWE-bench Multilingual model has the lowest official input price?
Claude Haiku 5.5 has the lowest matched official input price at $0.10 input / $0.50 output per 1M tokens.
Which models are fastest among SWE-bench Multilingual results?
The fastest matched records are MiniMax M2.1 (100.00 tok/s via MiniMax), MiniMax M2 (70.00 tok/s via MiniMax), and DeepSeek-V3.2 (Thinking) (50.00 tok/s via DeepSeek).
Does the highest score result prove overall model quality?
No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.