Evaluation directory
Browse benchmark definitions, capability categories, and model rankings.
Data as of 2026-10-22
Open any benchmark to inspect its leaderboard, scoring direction, evidence fields, and programmatic FAQ.
Benchmark | source | Category | Family | Metric | Coverage | Coverage tier | Evidence | Score eligible |
|---|
| BenchmarkMTEB English v2 Classification | sourceMTEB | Categoryclassification | FamilyMTEB English v2 | MetricOfficial leaderboard task-type mean | Coverage261 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkGPQA | sourceLLM Stats | Categoryphysics | FamilyGPQA | MetricScore | Coverage256 | Coverage tierfeatured | EvidenceC | Score eligibleNo |
| BenchmarkMTEB English v2 Reranking | sourceMTEB | Categoryreranking | FamilyMTEB English v2 | MetricOfficial leaderboard task-type mean | Coverage244 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkMTEB English v2 Clustering | sourceMTEB | Categoryclustering | FamilyMTEB English v2 | MetricOfficial leaderboard task-type mean | Coverage221 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkLM Arena Text | sourceLM Arena | CategoryUnspecified | Familylm-arena-text | MetricArena Rating | Coverage218 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkLM Arena Text Style Control | sourceLM Arena | CategoryUnspecified | Familylm-arena-text-style-control | MetricArena Rating | Coverage218 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkMTEB English v2 Retrieval | sourceMTEB | Categoryretrieval | FamilyMTEB English v2 | MetricOfficial leaderboard task-type mean | Coverage218 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkMTEB English v2 Semantic Similarity | sourceMTEB | Categorysemantic similarity | FamilyMTEB English v2 | MetricOfficial leaderboard task-type mean | Coverage215 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkAA Omniscience Accuracy | sourceArtificial Analysis | Categoryknowledge factuality | Familyomniscience | Metricomniscience-accuracy | Coverage201 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkAA CritPt | sourceArtificial Analysis | Categoryreasoning | Familycritpt | Metriccritpt | Coverage200 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkAA HLE Text No Tools | sourceArtificial Analysis | Categoryknowledge factuality | Familyhumanity-s-last-exam-no-tools-text-only | Metrichle | Coverage200 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkAA GPQA Diamond | sourceArtificial Analysis | Categoryreasoning | Familygpqa | Metricgpqa | Coverage199 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkAA LCR v1.1 | sourceArtificial Analysis | Categoryinstruction language context | Familyaa-lcr | Metriclcr | Coverage193 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkAA IFBench | sourceArtificial Analysis | Categoryinstruction language context | Familyifbench | Metricifbench | Coverage168 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkMMLU-Pro | sourceLLM Stats | Categorylanguage | FamilyMMLU-Pro | MetricScore | Coverage142 | Coverage tierfeatured | EvidenceB | Score eligibleNo |
| BenchmarkLM Arena Text Factuality | sourceLM Arena | CategoryUnspecified | Familylm-arena-text-factuality | MetricArena Rating | Coverage131 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkAIME 2025 | sourceLLM Stats | Categorymath | FamilyAIME 2025 | MetricScore | Coverage122 | Coverage tierfeatured | EvidenceC | Score eligibleNo |
| BenchmarkSWE-Bench Verified | sourceLLM Stats | Categoryreasoning | FamilySWE-Bench Verified | MetricScore | Coverage120 | Coverage tierfeatured | EvidenceC | Score eligibleNo |
| BenchmarkLM Arena Vision | sourceLM Arena | CategoryUnspecified | Familylm-arena-vision | MetricArena Rating | Coverage113 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkLM Arena Vision Style Control | sourceLM Arena | CategoryUnspecified | Familylm-arena-vision-style-control | MetricArena Rating | Coverage113 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkHumanity's Last Exam | sourceLLM Stats | Categorymath | FamilyHumanity's Last Exam | MetricScore | Coverage109 | Coverage tierfeatured | EvidenceB | Score eligibleNo |
| BenchmarkLM Arena Webdev | sourceLM Arena | CategoryUnspecified | Familylm-arena-webdev | MetricArena Rating | Coverage107 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkArtificial Analysis Text To Image | sourceArtificial Analysis | Categoryoverall quality | FamilyArtificial Analysis Text To Image | MetricElo | Coverage103 | Coverage tierfeatured | EvidenceB | Score eligibleNo |
| BenchmarkMMLU | sourceLLM Stats | Categorylanguage | FamilyMMLU | MetricScore | Coverage103 | Coverage tierfeatured | EvidenceB | Score eligibleNo |
| BenchmarkArtificial Analysis Text To Speech | sourceArtificial Analysis | Categorynaturalness | FamilyArtificial Analysis Text To Speech | MetricElo | Coverage98 | Coverage tierfeatured | EvidenceB | Score eligibleNo |
| BenchmarkAA AIME 2025 | sourceArtificial Analysis | Categorymath | Familyaime | Metricaime25 | Coverage96 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkAA SciCode Subtasks | sourceArtificial Analysis | Categorycoding tools | Familyscicode | Metricscicode | Coverage89 | Coverage tierfeatured | EvidenceB | Score eligibleYes |
| BenchmarkMIEB English Multimodal | sourceMTEB | Categorymultimodal | FamilyMIEB English | MetricOfficial leaderboard task-type mean | Coverage88 | Coverage tierfeatured | EvidenceA | Score eligibleNo |
| BenchmarkArtificial Analysis Image To Video | sourceArtificial Analysis | Categoryoverall quality | FamilyArtificial Analysis Image To Video | MetricElo | Coverage76 | Coverage tierfeatured | EvidenceB | Score eligibleNo |
| BenchmarkLiveCodeBench | sourceLLM Stats | Categoryreasoning | FamilyLiveCodeBench | MetricScore | Coverage76 | Coverage tierfeatured | EvidenceC | Score eligibleNo |
Benchmark and LM Arena values retain their original scales. Open a row to see its model results and scoring direction.
A quick view of benchmark breadth and current model coverage.