Customize timeouts for faster automatic failover on Vercel AI Gateway

AI Gateway now supports per-inference provider timeouts for faster failover than the provider default. If a provider doesn't start responding within your configured timeout, AI Gateway aborts the request and falls back to the next available provider.

Provider timeouts are available in beta for BYOK (Bring Your Own Key) credentials only, with support for system provider timeouts coming soon. Note that some providers don't support stream cancellation, so you may still be charged for timed-out requests depending on the provider.

Basic usage

Set timeouts per provider in milliseconds using providerTimeouts in providerOptions.gateway.

1
/* In this example, the BYOK credentials for GPT 5.4 would timeout
2
   after 15 seconds and fallback to system credentials. */
3
const result = streamText({
4
  model: 'openai/gpt-5.4',
5
  prompt,
6
  providerOptions: {
7
    gateway: {
8
      providerTimeouts: {
9
        byok: { openai: 15000 }, // 15 seconds
10
      },
11
    },
12
  },
13
});

Advanced usage with multiple providers and failover

Use with order to control both the provider sequence and failover speed.

1
/* This example tries Anthropic first with a 10-second timeout, falls back to Bedrock
2
   with 15 seconds, then Vertex with the default gateway timeout. */
3
const result = streamText({
4
  model: 'anthropic/claude-sonnet-4.6',
5
  prompt,
6
  providerOptions: {
7
    gateway: {
8
      order: ['anthropic', 'bedrock', 'vertex'],
9
      providerTimeouts: {
10
        byok: {
11
          anthropic: 10000,
12
          bedrock: 15000,
13
        },
14
      },
15
    },
16
  },
17
});

For more information, read the custom provider timeouts documentation.