AI Gateway supports OpenAI's Responses API

OpenAI's Responses API is now available through AI Gateway. The Responses API is a modern alternative to the Chat Completions API. Point your OpenAI SDK to AI Gateway's base URL and use the creator/model names to route requests. TypeScript and Python are both supported. All of the functionality in the Responses API was already accessible through AI Gateway via the AI SDK and Chat Completions API, but you can now use the Responses API directly.

Link to headingWhat you can do

• Text generation and streaming: Send prompts, get responses, stream tokens as they arrive

• Tool calling: Define functions the model can invoke, then feed results back

• Structured output: Constrain responses to a JSON schema

• Reasoning: Control how much effort the model spends thinking with configurable effort levels

Link to headingGetting started

Install the OpenAI SDK and point it at AI Gateway.

1
npm install openai

1
import OpenAI from 'openai';
2

3
const client = new OpenAI({
4
  apiKey: process.env.AI_GATEWAY_API_KEY,
5
  baseURL: 'https://ai-gateway.vercel.sh/v1',
6
});

Link to headingBasic example: text generation

Send a prompt and get a response from any supported model.

1
const response = await client.responses.create({
2
  model: 'openai/gpt-5.4',
3
  input: 'What is the best restaurant in San Francisco?',
4
});

Link to headingStructured output with reasoning

Combine reasoning levels with a JSON schema to get structured responses.

1
const response = await client.responses.create({
2
  model: 'anthropic/claude-sonnet-4.6',
3
  input: 'Build a Next.js app with auth and a dashboard page.',
4
  reasoning: { effort: 'high' },
5
  text: {
6
    format: {
7
      type: 'json_schema',
8
      name: 'app_plan',
9
      strict: true,
10
      schema: {
11
        type: 'object',
12
        properties: {
13
          files: { type: 'array', items: { type: 'string' } },
14
          summary: { type: 'string' },
15
        },
16
        required: ['files', 'summary'],
17
        additionalProperties: false,
18
      },
19
    },
20
  },
21
});

To learn more about the Responses API, read the documentation.