Vimi

Vimi is the world's first controllable character video generation model launched by SenseTime. It can generate character videos consistent with the target action through a variety of driving elements such as action videos, animations, sounds and text. Unlike conventional image expression control technology, Vimi can not only control character expressions, but also body movements, and generate reasonable hair, clothing, backgrounds, and even support light and shadow changes. This makes it the world's first stable controllable character video generation product. Vimi Function Controllable Characters: Vimi can generate highly consistent character expression and body movement videos, and users can...

At the 2024 World Artificial Intelligence Conference (WAIC), SenseTime launched Vimi, a large model for generating controllable human videos. The Vimi model uses SenseTime's advanced large model technology to generate human videos consistent with the target action from a single photo, achieving precise expression and body control. The model supports multiple driving methods, including video, animation, sound and text. It has years of accumulated facial tracking technology and precise control of details, and can generate highly consistent video content with harmonious light and shadow. Vimi's stability is particularly outstanding, and it can generate single-lens videos of more than 1 minute...

SenseTime released the first "controllable" character video generation model Vimi at the World Artificial Intelligence Conference (WAIC). It can generate character videos consistent with the target action through a photo of any style, and supports multiple driving methods. It can be driven by existing character videos, animations, sounds, text and other elements. Unlike image expression control technologies that can only control head expressions and movements, SenseTime claims that Vimi can not only achieve precise character expression control, but also control the natural body changes of the characters in the photo in the half-body area, and automatically generate hair and clothing that match the characters...