Nemotron 3.5 Lightning 30B
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 is a large language model (LLM) trained by NVIDIA. The model employs a hybrid Mixture-of-Experts architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers. The Lightning 3.5 model is released alongside a number of speculative decoding methods for faster text generation. The model has 3B active parameters and 30B parameters in total. Your use is subject to NVIDIA's Terms & Privacy Policies.
import { streamText } from 'ai'
const result = streamText({ model: 'nvidia/nemotron-3.5-lightning', prompt: 'Why is the sky blue?'})Copy link to headingPlayground
Try out Nemotron 3.5 Lightning 30B by NVIDIA. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.
Nemotron 3.5 Lightning 30B
Nemotron 3.5 Lightning 30B
Copy link to headingProviders
Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.
Copy link to headingThroughput24 hours
P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.
Copy link to headingLatency24 hours
P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the docs for more info.
Copy link to headingUptime24 hours
Direct request success rate on AI Gateway and per-provider. Visit the docs for more info.
Copy link to headingMore models by NVIDIA
| Model |
|---|
| 1M | 0.2s | 187tps | $0.50/M | $2.40/M | Read:$0.12/M Write:— | — |    | 06/04/2026 | |||||
| 256K | 0.2s | 167tps | $0.15/M | $0.65/M | — |  | 03/11/2026 | ||||||
| 262K | 0.3s | 210tps | $0.05/M | $0.24/M | — | | 12/15/2025 | ||||||
| 131K | 0.1s | 115tps | $0.20/M | $0.60/M | — | | 10/28/2025 | ||||||
| 131K | 0.2s | 207tps | $0.06/M | $0.23/M | — | | 08/18/2025 |