llmboard.aiAI model intelligence
Home

Model Rankings

OverallOpen ModelsAgentCodingReasoningMathKnowledgeInstruction FollowingTextVision
Image GenerationImage Editing
Video GenerationImage to VideoVideo Editing
Text to SpeechSpeech to Text
Embeddings

Efficiency

Chat Token PricingImage PricingVideo PricingAudio Pricing
Chat Speed & LatencyProvider Reliability

Benchmarks

GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-Pro
All Benchmarks

Tools

Model Directory

Scoring & Data

Scoring & Data
1367 models808 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll Benchmarks
llmboard.aiCopyright 2026 llmboard.ai

chat benchmark

Tau2 Airline Leaderboard

Tau2 Airline is a conversational-agent benchmark for airline customer service scenarios in dual-control environments.

Updated Oct 23, 2026

Models26
Model coverage26
MetricScore
EvidenceB

On this page

  • Ranking
  • Highlights
  • Distribution
  • Top models
  • About
  • FAQ

Tau2 Airline Ranking

Higher score ranks better on this benchmark.

26 rows
Columns

Show columns

Sort by
Rank
Model
Score
Percentile
Participants
Evidence
Evaluated
Rank01ModelMEMuse Glimmer-30BMetaScore78.00%Percentile100.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank02ModelMELongCat-Flash-Thinking-2601MeituanScore76.50%Percentile96.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank03ModelAMNova 2 OmniAmazonScore68.80%Percentile92.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank04ModelMELongCat-Flash-ThinkingMeituanScore67.50%Percentile88.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank05ModelOPGPT-5.1OpenAIScore67.00%Percentile84.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank06ModelOPGPT-5.1 InstantOpenAIScore67.00%Percentile80.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank07ModelOPGPT-5.1 ThinkingOpenAIScore67.00%Percentile76.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank08ModelFAEmber-1Fireworks AIScore66.00%Percentile72.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank09ModelAMNova 2 ProAmazonScore65.20%Percentile68.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank10ModelAMNova 2 LiteAmazonScore64.80%Percentile64.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank11ModelOPo3OpenAIScore64.80%Percentile60.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank12ModelANClaude Haiku 4.5AnthropicScore63.60%Percentile56.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank13ModelOPGPT-5OpenAIScore62.60%Percentile52.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank14ModelACQwen3-Next-80B-A3B-ThinkingAlibaba Cloud / Qwen TeamScore60.50%Percentile48.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank15ModelMELongCat-Flash-ChatMeituanScore58.00%Percentile44.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank16ModelMELongCat-Flash-LiteMeituanScore58.00%Percentile40.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank17ModelACQwen3-235B-A22B-Thinking-2507Alibaba Cloud / Qwen TeamScore58.00%Percentile36.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank18ModelLAEXAONE 4.5 33BLG AI ResearchScore56.50%Percentile32.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank19ModelMAKimi K2 InstructMoonshot AIScore56.50%Percentile28.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank20ModelMAKimi K2-Instruct-0905Moonshot AIScore56.50%Percentile24.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank21ModelNVNemotron 3 Super (120B A12B)NVIDIAScore56.25%Percentile20.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank22ModelINMercury 2InceptionScore53.00%Percentile16.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank23ModelNVNemotron 3 Nano (30B A3B)NVIDIAScore48.00%Percentile12.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank24ModelOPGPT-4oOpenAIScore45.50%Percentile8.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank25ModelACQwen3-Next-80B-A3B-InstructAlibaba Cloud / Qwen TeamScore45.50%Percentile4.00%Participants26EvidenceCEvaluatedOct 22, 2026
Rank26ModelACQwen3-235B-A22B-Instruct-2507Alibaba Cloud / Qwen TeamScore44.00%Percentile0.00%Participants26EvidenceCEvaluatedOct 22, 2026

Tau2 Airline Highlights

The leading models and scores on this benchmark.

Tau2 Airline Score Distribution

A closer view of the leading scores on this benchmark.

Tau2 Airline

The Top AI Models for Tau2 Airline

The first five results on this benchmark, with official price and output speed added where the model identity can be matched.

What is Tau2 Airline?

What Tau2 Airline measures and how its scores work.

A TAU2 airline domain benchmark in which AI agents and users interact with tools for tasks such as flight booking, modifications, cancellations, and refunds.

It measures agent coordination, communication, and ability to guide user actions, reported as a Score ratio.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
Tau2 Airline
Modality
text
Primary category
chat
Score direction
higher
LLMBoard eligible
No
Evaluation key
overall

LLM Stats. Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about Tau2 Airline.

Which model scores highest on Tau2 Airline?

Muse Glimmer-30B is currently ranked first with 78.00%.

What are the top three models on Tau2 Airline?

The current leaders are Muse Glimmer-30B (78.00%), LongCat-Flash-Thinking-2601 (76.50%), and Nova 2 Omni (68.80%).

Which Tau2 Airline model has the lowest official input price?

Mercury 2 has the lowest matched official input price at $0.25 input / $0.75 output per 1M tokens.

Which models are fastest among Tau2 Airline results?

The fastest matched records are Mercury 2 (1,009.00 tok/s via Inception), GPT-4o (132.00 tok/s via OpenAI), and GPT-5.1 (100.00 tok/s via OpenAI).

Does the highest score result prove overall model quality?

No. This benchmark measures one defined capability or task. The overall LLMBoard score uses a separate aggregation across eligible benchmark evidence.

What does Tau2 Airline measure?

It measures agent coordination, communication, and ability to guide user actions, reported as a Score ratio.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

26 model results are currently shown.

Does this benchmark affect the overall score?

No. This benchmark is shown for reference but does not contribute to the overall score.

Rank #1Muse Glimmer-30B78.00%
Rank #2LongCat-Flash-Thinking-260176.50%
Rank #3Nova 2 Omni68.80%
Rank #4LongCat-Flash-Thinking67.50%

Ranking basisThis tau2 airline AI model leaderboard uses descending score in the benchmark original unit. The leaderboard ranking keeps matched price and speed data separate from benchmark evidence.

  1. 01
    ME
    Muse Glimmer-30BMeta
    Score
    78.00%

    Strengths

    • Ranks #1 of 26 compared models
    • 100th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures Tau2 Airline, not total model capability
  2. 02
    ME
    LongCat-Flash-Thinking-2601Meituan
    Score
    76.50%

    Strengths

    • Ranks #2 of 26 compared models
    • 96th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures Tau2 Airline, not total model capability
  3. 03
    AM
    Amazon
    Score
    68.80%

    Strengths

    • Ranks #3 of 26 compared models
    • 92th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures Tau2 Airline, not total model capability
  4. 04
    ME
    Meituan
    Score
    67.50%

    Strengths

    • Ranks #4 of 26 compared models
    • 88th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures Tau2 Airline, not total model capability
  5. 05
    OP
    OpenAI
    Score
    67.00%
    Price
    $1.3 input / $10 output per 1M tokens
    Speed
    Up to 100.00 tok/s via OpenAI

    Strengths

    • Ranks #5 of 26 compared models
    • 84th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures Tau2 Airline, not total model capability

Selection summary

Best AI Models for Tau2 Airline

Muse Glimmer-30B currently leads Tau2 Airline with 78.00%. It is the top model on this specific benchmark, while the best LLM for the broader task should also be checked against other benchmarks, price, and runtime.

Use this leaderboard with the supporting benchmark results and coverage details above. A leaderboard position summarizes the selected ranking signal; it does not replace workload-specific testing.

Nova 2 Omni
LongCat-Flash-Thinking
GPT-5.1
Benchmark rank #1Muse Glimmer-30B78.00%
Benchmark rank #2LongCat-Flash-Thinking-260176.50%
Benchmark rank #3Nova 2 Omni68.80%