Skip to content
Dashboard
Vercel Live

Nov 12: Intro to AI Gateway

GPT-4.1 mini (Fast)

GPT 4.1 mini provides a balance between intelligence, speed, and cost that makes it an attractive model for many use cases. Your use is subject to OpenAI's Terms & Privacy Policies.

View API reference
Input and output price
Input $0.70, Output $2.80, Per 1M tokens
24h uptime
Loading AI Gateway uptime
Base model
import { streamText } from 'ai'
const result = streamText({
model: 'openai/gpt-4.1-mini-fast',
prompt: 'Why is the sky blue?'
})
Read docs

Copy link to headingPlayground

Try out GPT-4.1 mini (Fast) by OpenAI. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.

openai logo
openai logo

GPT-4.1 mini (Fast)

Copy link to headingProviders

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.

Checking availability for your team
Provider
Context
Max Output
Latency
Throughput
Cache Hit
Input
Output
Cache
Search
Capabilities
ZDR
No Training
Regional Inference
Free AI Gateway Credit
Release Date
1M33K0.5 s—
$0.70/M
$2.80/M
Read$0.18/M
$10/K+1 more
+3
—05/14/2025

Copy link to headingUptime

Direct request success rate on AI Gateway and per-provider. Uptime reflects the base model. Visit the docs for more info.

Copy link to headingThroughput

P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.

Copy link to headingLatency

P50 time to first token (TTFT) on live AI Gateway traffic, in milliseconds. View the docs for more info.

Getting started

Call GPT-4.1 mini (Fast) through AI Gateway with the AI SDK generateText and streamText functions, or through the OpenAI Chat Completions, OpenAI Responses, and Anthropic Messages APIs by changing the base URL. AI Gateway authenticates the request and routes it to an available provider.

Install the AI SDK (pnpm add ai dotenv), create an API key from the API Keys page, and set it as AI_GATEWAY_API_KEY in your environment. Full setup is covered in the text generation quickstart.

index.ts
import { generateText } from 'ai';
import 'dotenv/config';
async function main() {
const result = await generateText({
model: 'openai/gpt-4.1-mini-fast',
prompt: 'Why is the sky blue?',
});
console.log(result.text);
}
main().catch(console.error);

Top-level parameters

The same GPT-4.1 mini (Fast) request in each API format AI Gateway supports.

top-level-params.ts
import { generateText } from 'ai';
import 'dotenv/config';
async function main() {
const result = await generateText({
model: 'openai/gpt-4.1-mini-fast',
system: 'You are a concise technical assistant.',
prompt: 'Summarize the tradeoffs between static generation and SSR.',
maxOutputTokens: 1024,
temperature: 0.5,
});
console.log(result.text);
}
main().catch(console.error);

Standard parameters like prompt, messages, temperature, and tools work as documented in the AI SDK docs. These are the parameters with model-specific behavior.

ParameterTypeRequiredDescription
modelstringYesModel ID in the form creator/model, e.g. openai/gpt-4.1-mini-fast. AI Gateway routes the request to an available provider.
maxOutputTokensnumberNoHard cap on generated tokens. GPT-4.1 mini (Fast) supports up to 32,768 output tokens.
providerOptionsRecord<string, JSONValue>NoAI Gateway routing options under gateway, plus any provider-native options under the provider’s own namespace — see the table below.

Input limits

InputFormatsSourcesMax countMax sizeLimits
Text————Prompt and response share the 1M-token context window
Image—URL, base64, Uint8Array——Sent as image parts in messages; counts as input tokens
PDF—URL, base64, Uint8Array——Sent as file parts in messages; counts as input tokens

Provider options

Set AI Gateway routing options under providerOptions.gateway. For provider-specific options, pass them under the provider’s namespace as documented by the AI SDK.

Learn more in the AI SDK openai provider docs.

provider-options.ts
import { generateText } from 'ai';
import 'dotenv/config';
async function main() {
const result = await generateText({
model: 'openai/gpt-4.1-mini-fast',
prompt: 'Why is the sky blue?',
providerOptions: {
gateway: {
only: ['openai'],
},
},
});
console.log(result.text);
}
main().catch(console.error);

These AI Gateway routing options apply to every model. Provider-specific options pass through under the provider’s own namespace (for example providerOptions.anthropic) exactly as documented by the AI SDK.

ParameterTypeRequiredDescription
providerOptions.gateway.onlystring[]NoRestrict routing to these provider slugs. Requests fail over only within the listed providers.
providerOptions.gateway.orderstring[]NoPreferred provider order. Listed providers are tried first; unlisted providers remain available as fallbacks.
providerOptions.gateway.sort'cost' | 'ttft' | 'tps'NoRank candidate providers by price, time to first token, or tokens per second instead of the default routing order.
providerOptions.gateway.zeroDataRetentionbooleanNoRoute only to providers with a zero-data-retention policy for this model.

Routing across providers

AI Gateway serves the same model through multiple providers and fails over automatically. order expresses a preference while keeping every provider eligible; only is a hard allowlist — if none of the listed providers are available the request fails instead of falling back.

Options under a provider's own namespace (for example providerOptions.anthropic) are forwarded to that provider with the request. Providers ignore option namespaces that don't apply to them, so it is safe to set provider options alongside gateway routing options.

Image input

Send images alongside text as message parts. Images count as input tokens.

image-input.ts
import { generateText } from 'ai';
import 'dotenv/config';
async function main() {
const result = await generateText({
model: 'openai/gpt-4.1-mini-fast',
messages: [
{
role: 'user',
content: [
{ type: 'text', text: 'Describe this image.' },
{ type: 'image', image: 'https://example.com/photo.jpg' },
],
},
],
});
console.log(result.text);
}
main().catch(console.error);

PDF input

Attach PDFs as file parts. Their contents count as input tokens.

pdf-input.ts
import { generateText } from 'ai';
import 'dotenv/config';
async function main() {
const result = await generateText({
model: 'openai/gpt-4.1-mini-fast',
messages: [
{
role: 'user',
content: [
{ type: 'text', text: 'Summarize this document.' },
{
type: 'file',
mediaType: 'application/pdf',
data: 'https://example.com/document.pdf',
},
],
},
],
});
console.log(result.text);
}
main().catch(console.error);

Tool calling

Expose tools the model can call. Define each tool’s inputs with a Zod schema.

tool-calling.ts
import { generateText, tool } from 'ai';
import { z } from 'zod';
import 'dotenv/config';
async function main() {
const result = await generateText({
model: 'openai/gpt-4.1-mini-fast',
prompt: 'What is the weather in San Francisco?',
tools: {
getWeather: tool({
description: 'Get the current weather for a location',
inputSchema: z.object({ location: z.string() }),
execute: async ({ location }) => ({ location, temperatureC: 18 }),
}),
},
});
console.log(result.text);
}
main().catch(console.error);

Copy link to headingMore models by OpenAI

Model
Context
Latency
Throughput
Input
Output
Cache
Search
Capabilities
Providers
ZDR
No Training
Free AI Gateway Credit
Release Date
1.1M1.3 s85 tps
$1/M+2 more
$5/M+2 more
Read$0.05/M
Write$1.25/M
$10/K
+5
azure logo
openai logo
10/26/2026
1.1M1.4 s79 tps
$2/M+2 more
$10/M+2 more
Read$0.10/M
Write$2.50/M
$10/K
+5
azure logo
bedrock logo
openai logo
09/29/2026
1.1M1.0 s142 tps
$0.10/M+2 more
$0.50/M+2 more
Read$0.01/M
Write$0.13/M
$10/K
+5
azure logo
bedrock logo
openai logo
09/22/2026
1.1M0.8 s121 tps
$2/M+2 more
$10/M+2 more
Read$0.20/M
Write$2.50/M
$10/K
+5
azure logo
bedrock logo
openai logo
09/22/2026
1.1M0.6 s57 tps
$10/M+2 more
$50/M+2 more
Read$1/M
Write$12.50/M
$10/K
+6
azure logo
bedrock logo
openai logo
09/04/2026
1.1M0.6 s326 tps
$0.20/M+2 more
$1.20/M+2 more
Read$0.02/M
Write$0.25/M
$10/K
+6
azure logo
bedrock logo
openai logo
07/09/2026