long context benchmark
RepoQA Leaderboard
RepoQA is a long-context benchmark for evaluating code understanding through the Searching Needle Function (SNF) task across 500 code search tasks in 50 repositories and five programming languages.
Updated Sep 5, 2026
Models2
Model coverage2
MetricScore
EvidenceB
RepoQA Ranking
Higher score ranks better on this benchmark.
Sort by
Rank | Model | Score | Percentile | Participants | Evidence | Evaluated |
|---|
| Rank01 | ModelMI | Score85.00% | Percentile100.00% | Participants2 | EvidenceC | Evaluated |
| Rank02 | ModelMI | Score77.00% | Percentile0.00% | Participants2 | EvidenceC | Evaluated |
RepoQA Highlights
The leading models and scores on this benchmark.
RepoQA Score Distribution
A closer view of the leading scores on this benchmark.
The Top AI Models for RepoQA
The first five results on this benchmark, with official price and output speed added where the model identity can be matched.
What is RepoQA?
What RepoQA measures and how its scores work.
RepoQA is a benchmark in which Large Language Models locate specific functions in code repositories using natural language descriptions, covering Python, Java, TypeScript, C++, and Rust.
RepoQA measures code understanding and the ability to comprehend and navigate code repositories through a Score reported as a ratio.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- RepoQA
- Modality
- text
- Primary category
- long context
- Score direction
- higher
- LLMBoard eligible
- No
- Evaluation key
- overall
LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about RepoQA.
Which model scores highest on RepoQA?
Phi-3.5-MoE-instruct is currently ranked first with 85.00%.
What are the top three models on RepoQA?
The current leaders are Phi-3.5-MoE-instruct (85.00%) and Phi-3.5-mini-instruct (77.00%).
Which RepoQA model has the lowest official input price?
No matched official input price is currently available.
Which models are fastest among RepoQA results?
The fastest matched records are Phi-3.5-mini-instruct (23.00 tok/s via Azure).
Does the highest score result prove overall model quality?
No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.