Grok Imagine Video on AI Gateway

Generate high-quality videos with natural motion and audio using xAI's Grok Imagine Video, now in AI Gateway. Try it out now via the v0 Grok Creative Studio, AI SDK 6 or by selecting the model in the AI Gateway playground.

Grok Imagine is known for realistic motion and strong instruction following:

• Fast Generation: Generates clips in seconds rather than minutes

• Instruction Following: Understands complex prompts and follow-up instructions to tweak scenes

• Video Editing: Transform existing videos by changing style, swapping objects, or altering scenes

• Audio & Dialogue: Native audio generation with natural, expressive voices and accurate lip-sync

Link to headingThree ways to get started

Video generation is in beta and currently available for Pro and Enterprise plans and paid AI Gateway users.

• v0 Grok Creative Studio: The v0 team created a template that is powered by AI Gateway to create and showcase Grok Video and Image generations.

• AI SDK 6: Generate videos programmatically AI SDK 6's generateVideo.

1
import { experimental_generateVideo as generateVideo } from 'ai';
2

3
const { videos } = await generateVideo({
4
  model: 'xai/grok-imagine-video',
5
  prompt: 'A golden retriever catching a frisbee mid-air at the beach',
6
});

• Gateway Playground: Experiment with video models with no code in the configurable AI Gateway playground that's embedded in each model page. Compare providers, tweak prompts, and download results without writing code. To access, click any video gen model in the model list.

Link to headingAvailable Model

Link to headingSimple: Text-to-Video

Generate a video from a text description.

In this example, xai/grok-imagine-video is used to generate a video of 2 swans. Note that you can also specify the duration of the output.

1
import { experimental_generateVideo as generateVideo } from 'ai';
2

3
const { videos } = await generateVideo({
4
  model: 'xai/grok-imagine-video',
5
  prompt:
6
   `Two elegant white swans gliding on a misty lake at dawn, soft golden light,
7
    reflections on still water, romantic atmosphere, cinematic`,
8
  aspectRatio: '16:9',
9
  resolution: '1280x720',
10
  duration: 3,
11
});

Link to headingAdvanced: Reference-to-Video

Transform an existing video into a new style:

In this example, using a previous generation from Grok Imagine Video, the output was transformed into an animated watercolor style.

The source video is used and edited, which is useful for style transfer, object swapping, and scene transformations.

1
import { experimental_generateVideo as generateVideo } from 'ai';
2

3
const { videos } = await generateVideo({
4
  model: 'xai/grok-imagine-video',
5
  prompt:
6
   'Transform into anime style, soft hand-painted look, warm dreamy atmosphere',
7
  providerOptions: {
8
    xai: {
9
      videoUrl: sourceVideo,
10
    },
11
  },
12
});

Link to headingLearn More

For more examples and detailed configuration options for Grok Imagine Video, check out the Video Generation Documentation. You can also find simple getting started scripts with the Video Generation Quick Start.