[Mistral](/ai-gateway/models/labs/mistral)

# Mistral Nemo

Mistral Nemo is a 12B model with a context window of 131.1K tokens and the Tekken tokenizer trained on 100+ languages, offering ~30% better source code compression and improved multilingual efficiency as a drop-in replacement for Mistral 7B. Your use is subject to Mistral's [Terms](https://mistral.ai/terms) & [Privacy](https://mistral.ai/terms#privacy-policy) Policies.

Tool Use

[Use with AI Gateway](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%3Futm_source%3Dgateway-model-page%26utm_campaign%3Dai-gateway-models&title=Get+Started+with+Vercel+AI+Gateway) [View docs](https://vercel.com/docs/ai-gateway)

AI SDKChat CompletionsMessagesResponses

```
1import { streamText } from 'ai'
2

3const result = streamText({
4  model: 'mistral/mistral-nemo',
5  prompt: 'Why is the sky blue?'
6})
```

[Read docs](https://vercel.com/docs/ai-gateway/sdks-and-apis/ai-sdk)

[Overview](/ai-gateway/models/mistral-nemo) [API](/ai-gateway/models/mistral-nemo/api) [About](/ai-gateway/models/mistral-nemo/about) [Providers](/ai-gateway/models/mistral-nemo/providers) [Throughput](/ai-gateway/models/mistral-nemo/throughput) [Latency](/ai-gateway/models/mistral-nemo/latency) [Uptime](/ai-gateway/models/mistral-nemo/uptime) [Status](/ai-gateway/models/mistral-nemo/status) [Similar](/ai-gateway/models/mistral-nemo/similar) [FAQ](/ai-gateway/models/mistral-nemo/faq)

## [Copy link to heading](#playground)Playground

Try out Mistral Nemo by Mistral. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.

![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75)Mistral Nemo

![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=96&q=75)

Mistral Nemo

## [Copy link to heading](#providers)Providers

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the [docs](/docs/ai-gateway/provider-options) for more info. Using a provider means you agree to their terms, listed under Legal.

| Provider |
| --- |

| Context | Max Output | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | ZDR | No Training | Free Tier | Release Date |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |

| ![novita logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fnovita.png&w=48&q=75) [Novita AI](/ai-gateway/models/providers/novita) Legal:[Terms](https://novita.ai/legal/terms-of-service)•[Privacy](https://novita.ai/legal/privacy-policy) | 60K | 16K | 2.6s | 23tps | $0.04/M | $0.17/M |  | — |  |  |  |  | 07/18/2024 |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [Mistral](/ai-gateway/models/providers/mistral) Legal:[Terms](https://mistral.ai/terms)•[Privacy](https://mistral.ai/terms#privacy-policy) | 128K | 128K | 0.3s | 120tps | $0.15/M | $0.15/M |  | — |  |  |  |  | 07/18/2024 |  |
| ![deepinfra logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fdeepinfra.png&w=48&q=75) [DeepInfra](/ai-gateway/models/providers/deepinfra) Legal:[Terms](https://deepinfra.com/terms)•[Privacy](https://deepinfra.com/privacy) | 131K | 131K | 8.3s | 123tps | $0.02/M | $0.04/M |  | — |  |  |  |  | 07/18/2024 |  |

## [Copy link to heading](#throughput)Throughput24 hours

1W

1D

P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info.

## [Copy link to heading](#latency)Latency24 hours

1W

1D

P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info.

## [Copy link to heading](#uptime)Uptime24 hours

1W

1D

1H

Direct request success rate on AI Gateway and per-provider. Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/uptime) for more info.

1W

1D

1H

## [Copy link to heading](#more-models-by-mistral)More models by Mistral

All

Text

Code

Embed

| Model |
| --- |

| Context | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | Providers | ZDR | No Training | Free Tier | Release Date |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |

| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral\-large-3](/ai-gateway/models/mistral-large-3) | 256K | 0.5s | 84tps | $0.50/M | $1.50/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  |  | 12/02/2025 |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/ministral-14b](/ai-gateway/models/ministral-14b) | 256K | 0.3s | 101tps | $0.20/M | $0.20/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  |  | 12/02/2025 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/codestral-embed](/ai-gateway/models/codestral-embed) |  |  |  | $0.15/M |  |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  |  | 05/28/2025 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/ministral-3b](/ai-gateway/models/ministral-3b) | 128K | 0.3s | 215tps | $0.10/M | $0.10/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  |  | 10/16/2024 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral-small](/ai-gateway/models/mistral-small) | 32K | 0.4s | 126tps | $0.10/M | $0.30/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  |  | 09/17/2024 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral-embed](/ai-gateway/models/mistral-embed) |  |  |  | $0.10/M |  |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  |  | 12/11/2023 |  |

## [Copy link to heading](#about-mistral-nemo)About Mistral Nemo

Released July 18, 2024, Mistral Nemo was built in collaboration with NVIDIA and introduced the Tekken tokenizer, trained across 100+ languages, as its defining technical innovation. Tekken achieves ~30% better compression for source code compared to previous Mistral tokenizers, 2x better compression for Korean, and 3x better compression for Arabic. These compression gains directly reduce token consumption and cost.

At 12B parameters with a context window of 131.1K tokens, Mistral Nemo serves as a drop-in replacement for Mistral 7B. Mistral Nemo provides enhanced instruction following, multi-turn conversation quality, and code generation. Quantization-aware training enables FP8 inference without performance degradation. The combination of quantization awareness and Tekken compression gives Mistral Nemo deployment efficiency advantages.

Mistral Nemo's multilingual coverage spans English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi. Mistral Nemo is available under Apache 2.0, with both base and instruct weights on HuggingFace.

## [Copy link to heading](#what-to-consider-when-choosing-a-provider)What To Consider When Choosing a Provider

- Configuration: The Tekken tokenizer's compression efficiency means that for code-heavy or non-Latin-script workloads, you use fewer tokens per request than with models using conventional tokenizers.
- Zero Data Retention: Zero Data Retention is available for this model. It is offered on a per-provider and model basis. See the [documentation](https://vercel.com/docs/ai-gateway/security-and-compliance/zdr) for details.
- Authentication: AI Gateway authenticates requests using an [API key](https://vercel.com/docs/ai-gateway/authentication-and-byok#api-key-authentication) or [OIDC token](https://vercel.com/docs/ai-gateway/authentication-and-byok#oidc-token-authentication). You do not need to manage provider credentials directly.

## [Copy link to heading](#when-to-use-mistral-nemo)When to Use Mistral Nemo

### Best for

- Multilingual applications: Spanning European, East Asian, and Arabic-script languages
- Code-heavy workloads: Tekken's 30% compression advantage reduces token costs
- Korean or Arabic applications: 2-3x tokenizer compression is significant
- Mistral 7B migrations: Deployments that need a larger context window

### Consider alternatives when

- Larger general-purpose headroom: You need more capacity (consider Mistral Large 3)
- Code generation or agentic coding: Coding is the primary task (consider Devstral or Codestral)
- Higher reasoning depth: Tasks that require deeper reasoning traces (consider Magistral models)

## [Copy link to heading](#conclusion)Conclusion

Mistral Nemo's Tekken tokenizer is its distinguishing technical contribution, delivering efficiency gains for code and non-Latin-script languages that translate into lower costs per task. For multilingual applications and code-heavy pipelines, those gains compound at scale.