B station team open source anime video generation model AniSora, one click to create different styles of clips

May 18 News.Station BTeam May 12Open SourceBecartoonVideo Generation Model AniSora.

AniSora is able to create a variety of anime-style video clips with one click.It includes series, original Chinese animation, manga adaptations, VTuber content, anime PVs and ghost animation.

Animated content is highly sought after in today's film and television industry, says the B-site team. While advanced models such as Sora, Kling, and CogVideoX excel at natural video generation, they are still stretched thin for anime videos.

Additionally, the unique art style, exaggerated movement, and breaking of the laws of physics of anime made the review a huge challenge.

The project presents the complete system AniSora that covers:

• Data processing pipeline: over 10 million high quality data;
• Controllable Generation Model: Introduces the space-time mask module, which supports key animation production functions such as graph-generated video, frame interpolation, and local image guidance;
• Evaluation dataset: 948 diverse animation videos were collected, accompanied by double-blind evaluation experiments and VBench tests, and both character consistency and motion consistency reached SOTA.

1AIttached AniSora open source address:

• https://github.com/bilibili/Index-anisora/tree/main

• https://huggingface.co/IndexTeam/Index-anisora

• https://www.modelscope.cn/organization/bilibili-index