Wan v2.7 Reference-to-Video
Wan v2.7 Reference-to-Video is the Wan 2.7 reference-to-video model from Alibaba, generating new scenes from reference images and videos with combined subject and voice referencing at 720p or 1080p.
import { experimental_generateVideo as generateVideo } from 'ai';
const result = await generateVideo({ model: 'alibaba/wan-v2.7-r2v', prompt: 'A serene mountain lake at sunrise.'});About Wan v2.7 Reference-to-Video
Wan v2.7 Reference-to-Video is the reference-to-video member of Alibaba's Wan 2.7 release. You supply reference images, reference videos, or both, and Wan v2.7 Reference-to-Video places the referenced subjects into an entirely new scene described by an optional text prompt. Up to three reference videos can be attached to a single generation.
Combined subject and voice referencing is the notable addition in the 2.7 generation. Wan v2.7 Reference-to-Video lets you bind a subject's visual identity and vocal identity together from your reference material, keeping both consistent in the generated output. The reference pipeline also supports multi-subject work, so several referenced identities can interact in one scene, and multi-shot workflows keep those identities stable across scene cuts.
Output runs 2 to 10 seconds, with a default of 5 seconds, at 720p or 1080p. Five aspect ratio options cover landscape, portrait, square, and intermediate formats: 16:9, 9:16, 1:1, 4:3, and 3:4. The 2.7 generation also brings smoother, more coherent motion than the 2.6 line, which helps generated subjects hold up under close comparison to their references.