# Baseten models [Get started](https://vercel.com/d?to=%2F%5Bteam%5D%2F%7E%2Fai%3Futm_source%3Dgateway-providers-page%26utm_campaign%3Dai-gateway-providers&title=Get+Started+with+Vercel+AI+Gateway) [Read the docs](https://vercel.com/docs/ai-gateway) Route requests to Baseten through Vercel AI Gateway. Compare the models Baseten serves, with unified billing and automatic failover across providers. | Model | Context | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | ZDR | No Training | Regional Inference | Free Tier | Released | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![deepseek logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fdeepseek.png&w=48&q=75) [deepseek/deepseek-v4-pro-0813](/ai-gateway/models/deepseek-v4-pro-0813) | 1M | 1.1s | 184tps | $1.32/M | $3.96/M | Read:$0.13/M Write:— | — | | | | | | 08/12/2026 | | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | ![deepseek logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fdeepseek.png&w=48&q=75) [deepseek/deepseek-v4-flash-0731](/ai-gateway/models/deepseek-v4-flash-0731) | 1M | 0.9s | 280tps | $0.13/M | $0.26/M | Read:$0.03/M Write:— | — | | | | | | 07/31/2026 | | | ![thinkingmachines logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fthinkingmachines.png&w=48&q=75) [thinkingmachines/inkling-small](/ai-gateway/models/inkling-small) | 1M | 0.4s | 299tps | $0.50/M | $1.20/M | Read:$0.1/M Write:— | — | +2 | | | | | 07/30/2026 | | | ![moonshotai logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmoonshotai.png&w=48&q=75) [moonshotai/kimi-k3](/ai-gateway/models/kimi-k3) | 1M | 2.2s | 73tps | $3/M | $15/M | Read:$0.3/M Write:— | — | +1 | | | US | | 07/16/2026 | | | ![thinkingmachines logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fthinkingmachines.png&w=48&q=75) [thinkingmachines/inkling](/ai-gateway/models/inkling) | 256K | 0.3s | 270tps | $1/M | $4.05/M | Read:$0.17/M Write:— | — | +1 | | | US | | 07/15/2026 | | | ![zai logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fzai-256.png%3Fv%3D1786428782581&w=48&q=75) [zai/glm-5.2-fast](/ai-gateway/models/glm-5.2-fast) | 1M | | | $2.10/M | $6.60/M | Read:$0.21/M Write:— | — | | | | | | 06/23/2026 | | | ![zai logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fzai-256.png%3Fv%3D1786428782581&w=48&q=75) [zai/glm-5.2](/ai-gateway/models/glm-5.2) | 1M | 1.8s | 96tps | $1.50/MFast $2.10/M | $4.50/MFast $6.60/M | Read:$0.3/M Write:— | — | | | | US | | 06/16/2026 | | | ![moonshotai logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmoonshotai.png&w=48&q=75) [moonshotai/kimi-k2.7-code](/ai-gateway/models/kimi-k2.7-code) | 256K | 2.4s | 189tps | $0.95/M | $4/M | Read:$0.16/M Write:— | — | +2 | | | US | | 06/12/2026 | | | ![nvidia logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fnvidia.png&w=48&q=75) [nvidia/nemotron-3-ultra-550b-a55b](/ai-gateway/models/nemotron-3-ultra-550b-a55b) | 1M | 0.7s | 124tps | $0.60/M | $2.40/M | Read:$0.12/M Write:— | — | | | | US | | 06/04/2026 | | | ![deepseek logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fdeepseek.png&w=48&q=75) [deepseek/deepseek-v4-flash](/ai-gateway/models/deepseek-v4-flash) | 1M | 0.7s | 265tps | $0.13/M | $0.26/M | Read:$0.03/M Write:— | — | | | | | | 04/23/2026 | | | ![deepseek logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fdeepseek.png&w=48&q=75) [deepseek/deepseek-v4-pro](/ai-gateway/models/deepseek-v4-pro) | 1M | 0.7s | 157tps | $1.74/M | $3.48/M | Read:$0.15/M Write:— | — | | | | US | | 04/23/2026 | | | ![moonshotai logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fmoonshotai.png&w=48&q=75) [moonshotai/kimi-k2.6](/ai-gateway/models/kimi-k2.6) | 262K | 0.3s | | $0.95/M | $4/M | Read:$0.16/M Write:— | — | +1 | | | US | | 04/20/2026 | | | ![zai logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fzai-256.png%3Fv%3D1786428782581&w=48&q=75) [zai/glm-4.7](/ai-gateway/models/glm-4.7) | 200K | 0.4s | 177tps | $0.60/M | $2.20/M | Read:$0.12/M Write:— | — | | | | US | | 12/22/2025 | | | ![openai logo](/vc-ap-vercel-marketing/_next/image?url=https%3A%2F%2F7nyt0uhk7sse4zvn.public.blob.vercel-storage.com%2Fdocs-assets%2Fstatic%2Fdocs%2Fai-gateway%2Flogos%2Fopenai.png&w=48&q=75) [openai/gpt-oss-120b](/ai-gateway/models/gpt-oss-120b) | 131K | 0.3s | 294tps | $0.10/M | $0.50/M | | — | | | | US | | 08/05/2025 | |