Overview Integrations Deployments Activity Domains Usage Observability Storage Flags AI Gateway Agent Support Settings

AI Gateway

Seamlessly integrate AI models into your Vercel project. Learn more

Overview

Quick Start

Model List

API Keys

Integrations

Templates

Leaderboards

Playground

Documentation

Get Started

AI Gateway offers a unified API to multiple providers with budgets, monitoring, load-balancing, and fallbacks.

Install the AI SDK and AI Gateway packages

Install the AI SDK and AI Gateway packages to run TypeScript directly

mkdir demo && cd demo
pnpm init
pnpm install ai dotenv tsx @types/node

Set up Authentication

Choose between API key or OIDC token authentication

Option A: API Key

Create an API key and save it to a .env file

AI_GATEWAY_API_KEY=your_api_key_here

Option B: OIDC Token

Link your project and pull environment variables (auto-refreshes every 12 hours)

vercel link
vercel env pull

Create and run a script

Save this script as gateway.ts and run it with tsx

import { streamText } from 'ai';
import 'dotenv/config';

async function main() {
  const result = streamText({
    model: 'openai/gpt-4.1',
    prompt: 'Invent a new holiday and describe its traditions.',
  });

  for await (const textPart of result.textStream) {
    process.stdout.write(textPart);
  }

  console.log();
  console.log('Token usage:', await result.usage);
  console.log('Finish reason:', await result.finishReason);
}

main().catch(console.error);

pnpm tsx gateway.ts

Learn more about AI Gateway features including OpenAI compatibility, provider routing, and bring your own keys (BYOK).

Get Started

AI Gateway offers a unified API to multiple providers with budgets, monitoring, load-balancing, and fallbacks.

Install the AI SDK and tsx

Set up Authentication

Create and run a script