[Amazon](/ai-gateway/models/labs/amazon) # Nova Micro Nova Micro delivers text-only inference at high throughput with per-token pricing below multimodal Nova models in the same generation, purpose-built for latency-sensitive applications at scale. Your use is subject to Amazon's [Terms](https://aws.amazon.com/service-terms/) & [Privacy](https://aws.amazon.com/privacy/) Policies. Tool Use [Use with AI Gateway](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%3Futm_source%3Dgateway-model-page%26utm_campaign%3Dai-gateway-models&title=Get+Started+with+Vercel+AI+Gateway) [View docs](https://vercel.com/docs/ai-gateway) AI SDKChat CompletionsMessagesResponses ``` 1import { streamText } from 'ai' 2 3const result = streamText({ 4 model: 'amazon/nova-micro', 5 prompt: 'Why is the sky blue?' 6}) ``` [Read docs](https://vercel.com/docs/ai-gateway/sdks-and-apis/ai-sdk) [Overview](/ai-gateway/models/nova-micro) [API](/ai-gateway/models/nova-micro/api) [About](/ai-gateway/models/nova-micro/about) [Providers](/ai-gateway/models/nova-micro/providers) [Latency](/ai-gateway/models/nova-micro/latency) [Uptime](/ai-gateway/models/nova-micro/uptime) [Status](/ai-gateway/models/nova-micro/status) [Similar](/ai-gateway/models/nova-micro/similar) [FAQ](/ai-gateway/models/nova-micro/faq) ## [Copy link to heading](#playground)Playground Try out Nova Micro by Amazon. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days. ![amazon logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%20bedrock.png&w=48&q=75)Nova Micro ![amazon logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%20bedrock.png&w=96&q=75) Nova Micro ## [Copy link to heading](#providers)Providers Route requests across multiple providers. Copy a provider slug to set your preference. Visit the [docs](/docs/ai-gateway/provider-options) for more info. Using a provider means you agree to their terms, listed under Legal. | Provider | | --- | | Context | Max Output | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | ZDR | No Training | Regional Inference | Release Date | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![bedrock logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%2520bedrock.png&w=48&q=75) [Bedrock](/ai-gateway/models/providers/bedrock) Legal:[Terms](https://aws.amazon.com/service-terms/)•[Privacy](https://aws.amazon.com/privacy/) | 128K | 8K | 0.3s | | $0.04/M+1 more | $0.14/M+1 more | | — | | | | EU | 12/03/2024 | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | ## [Copy link to heading](#throughput)Throughput24 hours 1W 1D P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info. ## [Copy link to heading](#latency)Latency24 hours 1W 1D P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info. ## [Copy link to heading](#uptime)Uptime24 hours 1W 1D 1H Direct request success rate on AI Gateway and per-provider. Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/uptime) for more info. 1W 1D 1H ## [Copy link to heading](#more-models-by-amazon)More models by Amazon All Text Code Embed | Model | | --- | | Context | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | Providers | ZDR | No Training | Release Date | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![amazon logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%20bedrock.png&w=48&q=75) [amazon/nova-2-lite](/ai-gateway/models/nova-2-lite) | 1M | 0.4s | 232tps | $0.30/M | $2.50/M | Read:$0.07/M Write:— | — | +1 | ![bedrock logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%2520bedrock.png&w=48&q=75) | | | 12/02/2025 | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![amazon logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%20bedrock.png&w=48&q=75) [amazon/nova-lite](/ai-gateway/models/nova-lite) | 300K | 0.3s | 149tps | $0.06/M | $0.24/M | | — | | ![bedrock logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%2520bedrock.png&w=48&q=75) | | | 12/03/2024 | | | ![amazon logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%20bedrock.png&w=48&q=75) [amazon/nova-pro](/ai-gateway/models/nova-pro) | 300K | 0.4s | 123tps | $0.80/M | $3.20/M | | — | | ![bedrock logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%2520bedrock.png&w=48&q=75) | | | 12/03/2024 | | | ![amazon logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%20bedrock.png&w=48&q=75) [amazon/titan-embed\-text-v2](/ai-gateway/models/titan-embed-text-v2) | | | | $0.02/M | | | — | | ![bedrock logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Famazon%2520bedrock.png&w=48&q=75) | | | 04/30/2024 | | ## [Copy link to heading](#about-nova-micro)About Nova Micro Nova Micro launched alongside the rest of the first-generation Nova family, but its design philosophy differs. Nova Lite and Nova Pro layer in image and video understanding. Nova Micro drops multimodal support entirely. The result is a model that does one thing, text processing, at high speed and low cost. The tradeoff is intentional. Removing vision processing frees up architecture for generation throughput within a context window of 128K tokens. Even high-volume classification or tagging pipelines have low per-request costs. Many teams deploy Nova Micro as the default tier in a routing architecture. Straightforward text requests (classification, entity extraction, simple Q&A, short summaries) go to Micro. Only when a request involves images, requires deep reasoning, or exceeds the context of 128K tokens does it escalate to Lite, Pro, or a second-generation model. This pattern keeps average cost per request low while covering the full range of task complexity. ## [Copy link to heading](#what-to-consider-when-choosing-a-provider)What To Consider When Choosing a Provider - Configuration: If streaming throughput matters, test Nova Micro early. It's built for high text throughput within AI Gateway. - Zero Data Retention: Zero Data Retention is available for this model. It is offered on a per-provider and model basis. See the [documentation](https://vercel.com/docs/ai-gateway/security-and-compliance/zdr) for details. - Authentication: AI Gateway authenticates requests using an [API key](https://vercel.com/docs/ai-gateway/authentication-and-byok#api-key-authentication) or [OIDC token](https://vercel.com/docs/ai-gateway/authentication-and-byok#oidc-token-authentication). You do not need to manage provider credentials directly. ## [Copy link to heading](#when-to-use-nova-micro)When to Use Nova Micro ### Best for - Chatbots and conversational interfaces: Interactive experiences where response speed affects UX - Text classification at scale: Sentiment analysis and entity extraction across high request volumes - Autocomplete and suggestions: Inline features where generation speed matters - Default routing tier: Handle routine text requests at minimal cost in a model-routing architecture ### Consider alternatives when - Multimodal inputs required: Switch to Nova Lite or Nova Pro when inputs include images, documents, or video - Structured multi-step reasoning: Nova 2 Lite is better equipped for agentic tool use and deeper reasoning - Context beyond 128K tokens: Long documents or extended conversations require a model with a larger context window ## [Copy link to heading](#conclusion)Conclusion Nova Micro is the speed specialist of the Nova family. By focusing exclusively on text, it achieves throughput and pricing that suit many text-only workloads where response latency matters. Pair it with a routing layer that escalates to multimodal or reasoning-capable models when needed.