llmboard.aiAI model intelligence
Home

Model Rankings

OverallOpen ModelsAgentCodingReasoningMathKnowledgeInstruction FollowingTextVision
Image GenerationImage Editing
Video GenerationImage to VideoVideo Editing
Text to SpeechSpeech to Text
Embeddings

Efficiency

Chat Token PricingImage PricingVideo PricingAudio Pricing
Chat Speed & LatencyProvider Reliability

Benchmarks

GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-Pro
All Benchmarks

Tools

Model Directory

Scoring & Data

Scoring & Data
1224 models729 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll Benchmarks
llmboard.aiCopyright 2026 llmboard.ai

NVIDIA model product

Llama 3.1 Nemotron Ultra 253B

1 405B Instruct with a 128k context window.

Updated Sep 8, 2026. Default version: Llama 3.1 Nemotron Ultra 253B v1

LLMBoard Score29.4Llama 3.1 Nemotron Ultra 253B v1
Coverage20%6 benchmark families
Context windowN/ATokens
Official input priceN/AOfficial price unavailable

On this page

  • Capability
  • Benchmarks
  • Arena
  • Pricing
  • Runtime
  • Specification
  • Versions
  • Similar models
  • About
  • FAQ

Llama 3.1 Nemotron Ultra 253B Capability Profile

This profile uses the model's current scored version. Arena ratings and prices are shown separately.

Llama 3.1 Nemotron Ultra 253B v1 LLMBoard score breakdown

Llama 3.1 Nemotron Ultra 253B Benchmark Results

Benchmark scores for Llama 3.1 Nemotron Ultra 253B v1.

8 rows
Columns

Show columns

Sort by
Benchmark
Score
Rank
Participants
Percentile
Evidence
Evaluated
BenchmarkBFCL v2Score74.10%Rank02Participants5Percentile75.00%EvidenceCEvaluatedSep 8, 2026
BenchmarkMATH-500Score97.00%Rank08Participants32Percentile77.42%EvidenceCEvaluatedSep 8, 2026
BenchmarkIFEvalScore89.45%Rank22Participants68Percentile68.66%EvidenceCEvaluatedSep 8, 2026
BenchmarkLiveCodeBenchScore66.31%Rank27Participants75Percentile64.86%EvidenceCEvaluatedSep 8, 2026
BenchmarkAIME 2025Score72.50%Rank87Participants119Percentile27.12%EvidenceCEvaluatedSep 8, 2026
BenchmarkGPQAScore76.01%Rank110Participants247Percentile55.69%EvidenceCEvaluatedSep 8, 2026
BenchmarkLM Arena Text Style ControlScore1,347.45 ratingRank145Participants210Percentile31.10%EvidenceAEvaluatedSep 2, 2026
BenchmarkLM Arena TextScore1,319.35 ratingRank153Participants210Percentile27.27%EvidenceAEvaluatedSep 2, 2026

Llama 3.1 Nemotron Ultra 253B Arena Results

Preference and agent-evaluation results for the default version.

30 of 36 rows
Columns

Show columns

Sort by
Arena
Category
Rank
Rating / score
Votes
Observations
Result date
Arenatext style controlCategorymathRank123Rating / score1,380.50Votes209ObservationsN/AResult dateSep 2, 2026
ArenatextCategorymathRank133Rating / score1,359.41Votes209ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryhard prompts englishRank133Rating / score1,397.40Votes448ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategorycreative writingRank134Rating / score1,331.40Votes444ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryinstruction followingRank134Rating / score1,351.13Votes660ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryhard promptsRank136Rating / score1,374.55Votes713ObservationsN/AResult dateSep 2, 2026
ArenatextCategorycreative writingRank137Rating / score1,314.12Votes444ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryenglishRank138Rating / score1,375.79Votes1,491ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryindustry software and it servicesRank139Rating / score1,387.12Votes588ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategorycodingRank143Rating / score1,391.16Votes367ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryoverallRank145Rating / score1,347.45Votes2,549ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryinstruction followingRank146Rating / score1,307.78Votes660ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategorymulti turnRank147Rating / score1,342.53Votes374ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryexclude tiesRank148Rating / score1,303.74Votes1,699ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryindustry business and management and financial operationsRank148Rating / score1,341.92Votes254ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryindustry life and physical and social scienceRank148Rating / score1,360.62Votes498ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryindustry writing and literature and languageRank149Rating / score1,320.19Votes712ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryenglishRank150Rating / score1,344.99Votes1,491ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryindustry writing and literature and languageRank151Rating / score1,300.02Votes712ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategorylonger queryRank151Rating / score1,341.65Votes321ObservationsN/AResult dateSep 2, 2026
ArenatextCategorymulti turnRank152Rating / score1,317.38Votes374ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryhard prompts englishRank153Rating / score1,336.36Votes448ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryoverallRank153Rating / score1,319.35Votes2,549ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryhard promptsRank154Rating / score1,315.79Votes713ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryindustry life and physical and social scienceRank154Rating / score1,324.00Votes498ObservationsN/AResult dateSep 2, 2026
Arenatext style controlCategoryindustry entertainment and sports and mediaRank154Rating / score1,302.27Votes532ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryexclude tiesRank155Rating / score1,263.28Votes1,699ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryindustry business and management and financial operationsRank155Rating / score1,300.81Votes254ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryindustry software and it servicesRank155Rating / score1,326.89Votes588ObservationsN/AResult dateSep 2, 2026
ArenatextCategoryindustry entertainment and sports and mediaRank157Rating / score1,276.19Votes532ObservationsN/AResult dateSep 2, 2026

Llama 3.1 Nemotron Ultra 253B Pricing

Official vendor API pricing appears first, followed by individual provider offers.

Official API
N/A
Official provider
N/A
Lowest third-party
N/A
Tracked offerings
1
1 row
Columns

Show columns

Sort by
Provider
Provider model ID
Region
Input / 1M
Output / 1M
Context
Updated
ProviderNvidiaProvider model IDnvidia/llama-3.1-nemotron-ultra-253b-v1RegionglobalInput / 1MN/AOutput / 1MN/AContext128KUpdatedSep 8, 2026

Official prices use only the vendor's configured official Provider and positive standard USD PAYG rates. Third-party offers remain explicitly labeled.

Llama 3.1 Nemotron Ultra 253B Runtime Performance

Provider-specific output speed and catalog latency for Llama 3.1 Nemotron Ultra 253B v1. Runtime does not affect the capability score.

No runtime data

No provider-specific speed or latency record is linked to the default version yet.

Output Speed is generated output tokens received per second. Catalog latency is reported separately from observed provider TTFT.

Llama 3.1 Nemotron Ultra 253B Specifications

Technical details for the model's default version.

Version
Llama 3.1 Nemotron Ultra 253B v1
Released
Apr 7, 2025
Knowledge cutoff
Dec 1, 2023
Parameters
253B
Context window
N/A
Max output
N/A
Inputs
text
Outputs
text
Open weights
Yes
License
Llama 3.1 Community License

Llama 3.1 Nemotron Ultra 253B Versions

Available versions of this model. The score column identifies the version used in the overall ranking.

1 row
Columns

Show columns

Sort by
Version
Released
LLMBoard
Parameters
Context
Max output
Open weights
License
VersionLlama 3.1 Nemotron Ultra 253B v1ReleasedApr 7, 2025LLMBoard29.42Parameters253BContextN/AMax outputN/AOpen weightsYesLicenseLlama 3.1 Community License

Models similar to Llama 3.1 Nemotron Ultra 253B

Recommendations prioritize the same model type and family, then the closest LLMBoard score.

#178+1.94
NV

Nemotron Nano 9B

NVIDIA

31.36 LLMBoard

Details
#168+4.77
NV

Nemotron 3 Nano

NVIDIA

34.19 LLMBoard

Details
#155+7.85
NV

Nemotron 3.5 Lightning

NVIDIA

37.27 LLMBoard

Details
#208-7.89
NV

Llama 3.3 Nemotron Super 49B

NVIDIA

21.53 LLMBoard

Details
#123+14.86
NV

Nemotron 3 Super

NVIDIA

44.28 LLMBoard

Details
#247-20.88
NV

Llama 3.1 Nemotron Nano 8B

NVIDIA

8.54 LLMBoard

Details

What is Llama 3.1 Nemotron Ultra 253B?

Key information about Llama 3.1 Nemotron Ultra 253B and its available data.

1 Nemotron Ultra 253B is a large language model developed by NVIDIA using Neural Architecture Search (NAS), vertical compression, and multi-phase post-training. It supports SFT and reinforcement learning with GRPO for math, code, reasoning, chat, and tool calling, and is optimized for NVIDIA GPUs.

Data as of 2026-09-08.

FAQ

Common questions about Llama 3.1 Nemotron Ultra 253B.

When was Llama 3.1 Nemotron Ultra 253B released?

Llama 3.1 Nemotron Ultra 253B's default version was released on Apr 7, 2025.

How much does Llama 3.1 Nemotron Ultra 253B cost?

No official standard PAYG price is currently available for Llama 3.1 Nemotron Ultra 253B.

Who created Llama 3.1 Nemotron Ultra 253B?

Llama 3.1 Nemotron Ultra 253B was created by NVIDIA.

What is the context window for Llama 3.1 Nemotron Ultra 253B?

A context window is not available for the default version.

Is Llama 3.1 Nemotron Ultra 253B open weight?

Yes. The default version is marked as open weight under Llama 3.1 Community License.

How many API providers offer Llama 3.1 Nemotron Ultra 253B?

1 provider offerings are linked to the default version.

Browse runtime rankings