multimodal benchmark
Vibe-Eval Leaderboard
Vibe-Eval is a hard multimodal evaluation suite with 269 visual understanding prompts and expert-authored gold-standard responses.
Updated Sep 5, 2026
Models8
Model coverage8
MetricScore
EvidenceB
Vibe-Eval Ranking
Higher score ranks better on this benchmark.
Sort by
Rank | Model | Score | Percentile | Participants | Evidence | Evaluated |
|---|
| Rank01 | ModelGO | Score67.20% | Percentile100.00% | Participants8 | EvidenceC | Evaluated |
| Rank02 | ModelGO | Score65.60% | Percentile85.71% | Participants8 | EvidenceC | Evaluated |
| Rank03 | ModelGO | Score65.40% | Percentile71.43% | Participants8 | EvidenceC | Evaluated |
| Rank04 | ModelGO | Score56.30% | Percentile57.14% | Participants8 | EvidenceC | Evaluated |
| Rank05 | ModelGO | Score53.90% | Percentile42.86% | Participants8 | EvidenceC | Evaluated |
| Rank06 | ModelGO | Score51.30% | Percentile28.57% | Participants8 | EvidenceC | Evaluated |
| Rank07 | ModelGO | Score48.90% | Percentile14.29% | Participants8 | EvidenceC | Evaluated |
| Rank08 | ModelGO | Score40.90% | Percentile0.00% | Participants8 | EvidenceC | Evaluated |
Vibe-Eval Highlights
The leading models and scores on this benchmark.
Vibe-Eval Score Distribution
A closer view of the leading scores on this benchmark.
The Top AI Models for Vibe-Eval
The first five results on this benchmark, with official price and output speed added where the model identity can be matched.
What is Vibe-Eval?
What Vibe-Eval measures and how its scores work.
Vibe-Eval is a benchmark for measuring the progress of multimodal language models, with objectives covering day-to-day multimodal chat tasks and rigorous testing of frontier models.
It measures performance on visual understanding prompts using a Score reported as a ratio; its hard set contains more than 50% questions that all frontier models answer incorrectly.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- Vibe-Eval
- Modality
- multimodal
- Primary category
- multimodal
- Score direction
- higher
- LLMBoard eligible
- No
- Evaluation key
- overall
LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about Vibe-Eval.
Which model scores highest on Vibe-Eval?
Gemini 2.5 Pro Preview 06-05 is currently ranked first with 67.20%.
What are the top three models on Vibe-Eval?
The current leaders are Gemini 2.5 Pro Preview 06-05 (67.20%), Gemini 2.5 Pro (65.60%), and Gemini 2.5 Flash (65.40%).
Which Vibe-Eval model has the lowest official input price?
Gemini 2.5 Flash-Lite has the lowest matched official input price at $0.10 input / $0.40 output per 1M tokens.
Which models are fastest among Vibe-Eval results?
The fastest matched records are Gemini 2.0 Flash (183.00 tok/s via Google), Gemini 1.5 Flash (150.00 tok/s via Google), and Gemini 1.5 Flash 8B (150.00 tok/s via Google).
Does the highest score result prove overall model quality?
No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.