

AI Gateway is now generally available, providing a single unified API to access hundreds of AI models with transparent pricing and built-in observability.
With sub-20ms latency routing across multiple inference providers, AI Gateway delivers:
Transparent pricing with no markup on tokens (including Bring Your Own Keys)
Automatic failover for higher availability
High rate limits
Detailed cost and usage analytics
You can use AI Gateway with the AI SDK or through the OpenAI-compatible endpoint. With the AI SDK, it’s just a simple model string switch.
Get started with a single API call:
import { streamText } from 'ai'const result = streamText({ model: 'openai/gpt-5', prompt: 'How can AI Gateway not have a markup on tokens?'})Read more about the announcement, learn more about AI Gateway, or get started now.
Reference Architecture
Choose a stack and work through the decisions behind it, with curated documentation, guides, templates, and courses to help you build.
- Agent stack: Build and operate agents with models, tools, and durable workflows.
- Web applications: Choose rendering, data, authentication, and caching approaches.
- Backends: Choose a runtime, connect services, and run background work.
Build with prompts
Build an app, extend an agent, or improve your project with ready-to-use prompts for your coding agent.