llmboard.aiAI model intelligence
Home

Model Rankings

OverallOpen ModelsAgentCodingReasoningMathKnowledgeInstruction FollowingTextVision
Image GenerationImage Editing
Video GenerationImage to VideoVideo Editing
Text to SpeechSpeech to Text
Embeddings

Efficiency

Chat Token PricingImage PricingVideo PricingAudio Pricing
Chat Speed & LatencyProvider Reliability

Benchmarks

GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-Pro
All Benchmarks

Tools

Model Directory

Scoring & Data

Scoring & Data
1224 models729 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll Benchmarks
llmboard.aiCopyright 2026 llmboard.ai

multimodal benchmark

OSWorld Leaderboard

OSWorld is a multimodal benchmark with 369 computer tasks involving real web and desktop applications, OS file I/O, and multi-application workflows across Ubuntu, Windows, and macOS.

Updated Sep 5, 2026

Models20
Model coverage20
MetricScore
EvidenceB

On this page

  • Ranking
  • Highlights
  • Distribution
  • Top models
  • About
  • FAQ

OSWorld Ranking

Higher score ranks better on this benchmark.

20 rows
Columns

Show columns

Sort by
Rank
Model
Score
Percentile
Participants
Evidence
Evaluated
Rank01ModelBYSeed 2.1 ProByteDanceScore78.80%Percentile100.00%Participants20EvidenceCEvaluatedSep 8, 2026
Rank02ModelBYSeed 2.1 TurboByteDanceScore76.40%Percentile94.74%Participants20EvidenceCEvaluatedSep 8, 2026
Rank03ModelANClaude Opus 4.6AnthropicScore72.70%Percentile89.47%Participants20EvidenceCEvaluatedSep 8, 2026
Rank04ModelANClaude Sonnet 4.6AnthropicScore72.50%Percentile84.21%Participants20EvidenceCEvaluatedSep 8, 2026
Rank05ModelACQwen3 VL 235B A22B InstructAlibaba Cloud / Qwen TeamScore66.70%Percentile78.95%Participants20EvidenceCEvaluatedSep 8, 2026
Rank06ModelANClaude Opus 4.5AnthropicScore66.30%Percentile73.68%Participants20EvidenceCEvaluatedSep 8, 2026
Rank07ModelZAGLM-5V-TurboZhipu AIScore62.30%Percentile68.42%Participants20EvidenceCEvaluatedSep 8, 2026
Rank08ModelANClaude Sonnet 4.5AnthropicScore61.40%Percentile63.16%Participants20EvidenceCEvaluatedSep 8, 2026
Rank09ModelANClaude Haiku 4.5AnthropicScore50.70%Percentile57.89%Participants20EvidenceCEvaluatedSep 8, 2026
Rank10ModelACQwen3 VL 32B ThinkingAlibaba Cloud / Qwen TeamScore41.00%Percentile52.63%Participants20EvidenceCEvaluatedSep 8, 2026
Rank11ModelACQwen3 VL 235B A22B ThinkingAlibaba Cloud / Qwen TeamScore38.10%Percentile47.37%Participants20EvidenceCEvaluatedSep 8, 2026
Rank12ModelACQwen3 VL 8B InstructAlibaba Cloud / Qwen TeamScore33.90%Percentile42.11%Participants20EvidenceCEvaluatedSep 8, 2026
Rank13ModelACQwen3 VL 8B ThinkingAlibaba Cloud / Qwen TeamScore33.90%Percentile36.84%Participants20EvidenceCEvaluatedSep 8, 2026
Rank14ModelACQwen3 VL 32B InstructAlibaba Cloud / Qwen TeamScore32.60%Percentile31.58%Participants20EvidenceCEvaluatedSep 8, 2026
Rank15ModelACQwen3 VL 4B ThinkingAlibaba Cloud / Qwen TeamScore31.40%Percentile26.32%Participants20EvidenceCEvaluatedSep 8, 2026
Rank16ModelACQwen3 VL 30B A3B ThinkingAlibaba Cloud / Qwen TeamScore30.60%Percentile21.05%Participants20EvidenceCEvaluatedSep 8, 2026
Rank17ModelACQwen3 VL 30B A3B InstructAlibaba Cloud / Qwen TeamScore30.30%Percentile15.79%Participants20EvidenceCEvaluatedSep 8, 2026
Rank18ModelACQwen3 VL 4B InstructAlibaba Cloud / Qwen TeamScore26.20%Percentile10.53%Participants20EvidenceCEvaluatedSep 8, 2026
Rank19ModelACQwen2.5 VL 72B InstructAlibaba Cloud / Qwen TeamScore8.83%Percentile5.26%Participants20EvidenceCEvaluatedSep 8, 2026
Rank20ModelACQwen2.5 VL 32B InstructAlibaba Cloud / Qwen TeamScore5.92%Percentile0.00%Participants20EvidenceCEvaluatedSep 8, 2026

OSWorld Highlights

The leading models and scores on this benchmark.

OSWorld Score Distribution

A closer view of the leading scores on this benchmark.

OSWorld

The Top AI Models for OSWorld

The first five results on this benchmark, with official price and output speed added where the model identity can be matched.

What is OSWorld?

What OSWorld measures and how its scores work.

OSWorld is a scalable real computer environment for multimodal agents that supports task setup, execution-based evaluation, and interactive learning across Ubuntu, Windows, and macOS.

It uses the Score metric, reported as a ratio, for tasks involving real web and desktop applications, OS file I/O, and multi-application workflows.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
OSWorld
Modality
multimodal
Primary category
multimodal
Score direction
higher
LLMBoard eligible
No
Evaluation key
overall

LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about OSWorld.

Which model scores highest on OSWorld?

Seed 2.1 Pro is currently ranked first with 78.80%.

What are the top three models on OSWorld?

The current leaders are Seed 2.1 Pro (78.80%), Seed 2.1 Turbo (76.40%), and Claude Opus 4.6 (72.70%).

Which OSWorld model has the lowest official input price?

Claude Haiku 4.5 has the lowest matched official input price at $1.0 input / $5.0 output per 1M tokens.

Which models are fastest among OSWorld results?

The fastest matched records are Claude Opus 4.6 (123.15 tok/s via Anthropic), Claude Haiku 4.5 (100.00 tok/s via Vertex AI), and Claude Opus 4.5 (42.00 tok/s via Anthropic).

Does the highest score result prove overall model quality?

No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.

What does OSWorld measure?

It uses the Score metric, reported as a ratio, for tasks involving real web and desktop applications, OS file I/O, and multi-application workflows.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

20 model results are currently shown.

Does this benchmark affect the overall score?

No. This benchmark is shown for reference but does not contribute to the overall score.

Rank #1Seed 2.1 Pro78.80%
Rank #2Seed 2.1 Turbo76.40%
Rank #3Claude Opus 4.672.70%
Rank #4Claude Sonnet 4.672.50%

Ranking basisThis osworld AI model leaderboard uses descending score in the benchmark original unit. The leaderboard ranking keeps matched price and speed data separate from benchmark evidence.

  1. 01
    BY
    Seed 2.1 ProByteDance
    Score
    78.80%

    Strengths

    • Ranks #1 of 20 compared models
    • 100th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures OSWorld, not total model capability
  2. 02
    BY
    Seed 2.1 TurboByteDance
    Score
    76.40%

    Strengths

    • Ranks #2 of 20 compared models
    • 95th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures OSWorld, not total model capability
  3. 03
    AN
    Anthropic
    Score
    72.70%
    Price
    $5.0 input / $25 output per 1M tokens
    Speed
    Up to 123.15 tok/s via Anthropic

    Strengths

    • Ranks #3 of 20 compared models
    • 89th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures OSWorld, not total model capability
  4. 04
    AN
    Anthropic
    Score
    72.50%
    Price
    $3.0 input / $15 output per 1M tokens
    Speed
    Up to 7.67 tok/s via Anthropic

    Strengths

    • Ranks #4 of 20 compared models
    • 84th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures OSWorld, not total model capability
  5. 05
    AC
    Alibaba Cloud / Qwen Team
    Score
    66.70%

    Strengths

    • Ranks #5 of 20 compared models
    • 79th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures OSWorld, not total model capability

Selection summary

Best AI Models for OSWorld

Seed 2.1 Pro currently leads OSWorld with 78.80%. It is the top model on this specific benchmark, while the best LLM for the broader task should also be checked against other benchmarks, price, and runtime.

Use this leaderboard with the supporting benchmark results and coverage details above. A leaderboard position summarizes the selected ranking signal; it does not replace workload-specific testing.

Claude Opus 4.6
Claude Sonnet 4.6
Qwen3 VL 235B A22B Instruct
Benchmark rank #1Seed 2.1 Pro78.80%
Benchmark rank #2Seed 2.1 Turbo76.40%
Benchmark rank #3Claude Opus 4.672.70% · $5.0 input / $25 output per 1M tokens