Gemma 4 on AI Gateway

Gemma 4 26B (MoE) and 31B (Dense) from Google are now available on Vercel AI Gateway.

Built on the same architecture as Gemini 3, both open models support function-calling, agentic workflows, structured JSON output, and system instructions. Both support up to 256K context, 140+ languages, and native vision.

• 26B (MoE): Activates only 3.8B of its 26B total parameters during inference, optimized for lower latency and faster tokens-per-second.

• 31B (Dense): All parameters are active during inference, targeting higher output quality. Better suited as a foundation for fine-tuning.

To use Gemma 4, set model to google/gemma-4-31b-it or google/gemma-4-26b-a4b-it in the AI SDK.

1
import { streamText } from 'ai';
2

3
const result = streamText({
4
  model: 'google/gemma-4-26b-a4b-it',
5
  // or 'google/gemma-4-31b-it'
6
  prompt:
7
    `Break down this codebase into modules, identify circular
8
     dependencies, and generate a refactoring plan with
9
     implementation steps.`,
10
});

AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, observability, Bring Your Own Key support, and intelligent provider routing with automatic retries.

Learn more about AI Gateway, view the AI Gateway model leaderboard or try it in our model playground.