Wan models on AI Gateway

Generate stylized videos and transform existing footage with Alibaba's Wan models, now available through AI Gateway. Try them out now via AI SDK 6 or by selecting the models in the AI Gateway playground.

Wan produces artistic videos with smooth motion and can use existing content to keep videos consistent:

• Character Reference (R2V): Extract character appearance and voice from reference videos/images to generate new scenes

• Flash Variants: Faster generation times for quick iterations

• Flexible Resolutions: Support for 480p, 720p, and 1080p output

Link to headingTwo ways to get started

Video generation is in beta and currently available for Pro and Enterprise plans and paid AI Gateway users.

• AI SDK 6: Generate videos programmatically AI SDK 6's generateVideo.

1
import { experimental_generateVideo as generateVideo } from 'ai';
2

3
const { videos } = await generateVideo({
4
  model: 'alibaba/wan-v2.6-t2v',
5
  prompt: 'Watercolor painting of a koi pond coming to life.',
6
});

• Gateway Playground: Experiment with video models with no code in the configurable AI Gateway playground that's embedded in each model page. Compare providers, tweak prompts, and download results without writing code. To access, click any video gen model in the model list.

Link to headingAvailable Models

Link to headingSimple: Text-to-Video with Audio

Generate a stylized video from a text description.

You can use detailed prompts and specify styles with the Wan models to achieve the desired output generation. The example here uses alibaba/wan-v2.6-t2v:

1
import { experimental_generateVideo as generateVideo } from 'ai';
2

3
const { videos } = await generateVideo({
4
  model: 'alibaba/wan-v2.6-t2v',
5
  prompt:
6
   `Animated rainy Tokyo street at night, anime style,
7
    neon signs reflecting on wet pavement, people with umbrellas
8
    walking past, red and blue lights glowing through the rain.`,
9
  resolution: '1280x720',
10
  duration: 5,
11
});

Link to headingAdvanced: Reference-to-Video

Generate new scenes using characters extracted from reference images or videos.

In this example, 2 reference images of dogs are used to generate the final video.

Using alibaba/wan-v2.6-r2v-flash here, you can instruct the model to utilize the people/characters within the prompt. Wan suggests using character1, character2, etc. in the prompt for multi-reference to video to get the best results.

1
import { experimental_generateVideo as generateVideo } from 'ai';
2

3
const { videos } = await generateVideo({
4
  model: 'alibaba/wan-v2.6-r2v-flash',
5
  prompt:
6
   `character1 and character2 are playing together on the beach in San Francisco
7
    with the Golden Gate Bridge in the background, sunny day, waves crashing`,
8
  resolution: '1280x720',
9
  duration: 5,
10
  providerOptions: {
11
    alibaba: {
12
      referenceUrls: [shibaImage, yorkieImage],
13
    },
14
  },
15
});

Link to headingLearn More

For more examples and detailed configuration options for Wan models, check out the Video Generation Documentation. You can also find simple getting started scripts with the Video Generation Quick Start.