Skip to content
NVIDIA

Nemotron 3 Ultra

Nemotron 3 Ultra is NVIDIA's largest open reasoning model, a hybrid Mamba-Transformer MoE with 550B total and 55B active parameters, latent MoE routing, multi-token prediction, and a context window of 1M tokens for long-running agent workflows.

ReasoningTool UseImplicit Caching
index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'nvidia/nemotron-3-ultra-550b-a55b',
  prompt: 'Why is the sky blue?'
})
OverviewAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ

Frequently Asked Questions

  • Why does "550B total, 55B active" matter for inference cost?

    You pay compute proportional to the active parameters, not the total. Nemotron 3 Ultra draws on 550B parameters of learned knowledge while activating 55B per token. Latent MoE routing selects the relevant experts in a compressed latent space, which keeps routing overhead low.

  • How does Nemotron 3 Ultra fit alongside Nemotron 3 Nano and Super?

    Nemotron 3 Ultra is the largest tier of the Nemotron 3 family. Nano (30B/3B active) handles high-throughput lightweight steps, Super (120B/12B active) covers mid-tier multi-agent planning, and Nemotron 3 Ultra takes the hardest planning, synthesis, and verification calls. Many pipelines pair a smaller tier for routine steps with Nemotron 3 Ultra for complex decisions.

  • How does Nemotron 3 Ultra handle a context window of 1M tokens?

    Mamba layers process sequences with linear-time complexity, so long contexts avoid the quadratic memory growth of pure attention. Nemotron 3 Ultra scores 95% on the Ruler benchmark at 1M tokens, which tests recall across very long inputs.

  • Is Nemotron 3 Ultra open source?

    Yes. NVIDIA released the weights, data, and recipes under the Linux Foundation's OpenMDW-1.1 license, a permissive license built for open model distributions.

  • Does Nemotron 3 Ultra support Zero Data Retention?

    Yes, Zero Data Retention is available for this model. Zero Data Retention is offered on a per-provider basis. See https://vercel.com/docs/ai-gateway/capabilities/zdr for details.

  • Where are per-token prices listed?

    Rates are listed on this page. They reflect the providers routing through AI Gateway and shift when providers update their pricing.