[Mistral](/ai-gateway/models/labs/mistral)

# Mistral Small

Mistral Small (September 17, 2024) is a 22B mid-tier model with improved reasoning, alignment, and code at about 80% lower list pricing than its predecessor in Mistral's September 2024 table. Your use is subject to Mistral's [Terms](https://mistral.ai/terms) & [Privacy](https://mistral.ai/terms#privacy-policy) Policies.

Tool UseVision (Image)

[Use with AI Gateway](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%3Futm_source%3Dgateway-model-page%26utm_campaign%3Dai-gateway-models&title=Get+Started+with+Vercel+AI+Gateway) [View docs](https://vercel.com/docs/ai-gateway)

AI SDKChat CompletionsMessagesResponses

```
1import { streamText } from 'ai'
2

3const result = streamText({
4  model: 'mistral/mistral-small',
5  prompt: 'Why is the sky blue?'
6})
```

[Read docs](https://vercel.com/docs/ai-gateway/sdks-and-apis/ai-sdk)

[Overview](/ai-gateway/models/mistral-small) [API](/ai-gateway/models/mistral-small/api) [About](/ai-gateway/models/mistral-small/about) [Providers](/ai-gateway/models/mistral-small/providers) [Throughput](/ai-gateway/models/mistral-small/throughput) [Latency](/ai-gateway/models/mistral-small/latency) [Uptime](/ai-gateway/models/mistral-small/uptime) [Status](/ai-gateway/models/mistral-small/status) [Similar](/ai-gateway/models/mistral-small/similar) [FAQ](/ai-gateway/models/mistral-small/faq)

## [Copy link to heading](#playground)Playground

Try out Mistral Small by Mistral. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.

![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75)Mistral Small

![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=96&q=75)

Mistral Small

## [Copy link to heading](#providers)Providers

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the [docs](/docs/ai-gateway/provider-options) for more info. Using a provider means you agree to their terms, listed under Legal.

| Provider |
| --- |

| Context | Max Output | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | ZDR | No Training | Release Date |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |

| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [Mistral](/ai-gateway/models/providers/mistral) Legal:[Terms](https://mistral.ai/terms)•[Privacy](https://mistral.ai/terms#privacy-policy) | 32K | 4K | 0.3s | 157tps | $0.10/M | $0.30/M |  | — |  |  |  | 09/17/2024 |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |

## [Copy link to heading](#throughput)Throughput24 hours

1W

1D

P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info.

## [Copy link to heading](#latency)Latency24 hours

1W

1D

P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/metrics) for more info.

## [Copy link to heading](#uptime)Uptime24 hours

1W

1D

1H

Direct request success rate on AI Gateway and per-provider. Visit the [docs](https://vercel.com/docs/ai-gateway/models-and-providers/uptime) for more info.

1W

1D

1H

## [Copy link to heading](#more-models-by-mistral)More models by Mistral

All

Text

Code

Embed

| Model |
| --- |

| Context | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | Providers | ZDR | No Training | Release Date |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |

| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/devstral\-small-2](/ai-gateway/models/devstral-small-2) | 256K | 0.3s |  | $0.10/M | $0.30/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  | 12/09/2025 |  |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/devstral-2](/ai-gateway/models/devstral-2) | 256K | 0.3s | 33tps | $0.40/M | $2/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  | 12/09/2025 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral\-large-3](/ai-gateway/models/mistral-large-3) | 256K | 0.5s | 57tps | $0.50/M | $1.50/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  | 12/02/2025 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/ministral-14b](/ai-gateway/models/ministral-14b) | 256K | 0.3s | 80tps | $0.20/M | $0.20/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  | 12/02/2025 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/ministral-3b](/ai-gateway/models/ministral-3b) | 128K | 0.3s | 133tps | $0.10/M | $0.10/M |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  | 10/16/2024 |  |
| ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) [mistral/mistral-embed](/ai-gateway/models/mistral-embed) |  |  |  | $0.10/M |  |  | — |  | ![mistral logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmistral.png&w=48&q=75) |  |  | 12/11/2023 |  |

## [Copy link to heading](#about-mistral-small)About Mistral Small

Released September 17, 2024, the Mistral Small update was primarily a pricing event, with an approximately 80% reduction in input and output token pricing compared to the prior release. Simultaneous capability improvements in human alignment, reasoning, and code generation made this a significant upgrade rather than just a price cut.

At 22B parameters, Mistral Small sits between Mistral NeMo (12B) and Mistral Large 2 in the lineup Mistral described in September 2024. Mistral Small targets translation, summarization, and sentiment analysis.

The pricing cut plus capability improvements made Mistral Small a common pick for production workloads that previously ran larger, more expensive Mistral endpoints.

## [Copy link to heading](#what-to-consider-when-choosing-a-provider)What To Consider When Choosing a Provider

- Configuration: At 22B parameters, Mistral Small sits between Mistral NeMo 12B and Mistral Large 2 as a mid-point in the lineup, per Mistral's September 2024 post.
- Zero Data Retention: Zero Data Retention is available for this model. It is offered on a per-provider and model basis. See the [documentation](https://vercel.com/docs/ai-gateway/security-and-compliance/zdr) for details.
- Authentication: AI Gateway authenticates requests using an [API key](https://vercel.com/docs/ai-gateway/authentication-and-byok#api-key-authentication) or [OIDC token](https://vercel.com/docs/ai-gateway/authentication-and-byok#oidc-token-authentication). You do not need to manage provider credentials directly.

## [Copy link to heading](#when-to-use-mistral-small)When to Use Mistral Small

### Best for

- Translation and summarization at scale: High-volume translation, summarization, and sentiment analysis workloads
- 22B mid-tier production: Workloads that need competitive per-token pricing
- Mid-point between NeMo and Large: Applications where this capability fit is right
- Cost optimization: For workloads previously using larger Mistral models

### Consider alternatives when

- Higher reasoning capability: For workloads that need more depth (consider Mistral Large 3 or Magistral)
- Tekken tokenizer compression: You need multilingual compression advantages (consider Mistral NeMo)
- Vision input: Your workload needs image input (consider Pixtral models)

## [Copy link to heading](#conclusion)Conclusion

Mistral Small's September 17, 2024 update cut list pricing and improved alignment, reasoning, and code quality in Mistral's post. An 80% cost reduction shipped alongside those capability changes. Mistral Small remains a fit for teams that want a 22B mid-tier model through AI Gateway.