Tiantu Wanjing teamTiantu Wanjingreleased a universal tool for video audio called Sora Opera, which not only dubs AI-generated videos, but also re-dubs pre-existing videos.
On Saturday, video tool Pika announced that users can add soundtracks and sound effects to generated videos, as well as add sound effects to previously muted videos. The feature now removes the 'mute mode' from videos, but requires users to purchase a Pika membership to experience it.
In early March this year, it is reported that the domestic team has a similar audio generation tool, and it was internally tested for half a year, used for adding sound effects or background music to the mute screens of text-generated videos. Currently, this tool is about to be launched in March in cooperation with Huawei Cloud, and the development team 'Tiantu Wanjing' provides the experience site.Sora OperaThe project's experience site will be open to the public in a few days.
Sora Opera plans to offer two features: text-generated sound effects and video soundtracks, but the cloud version will be available to partners first due to the cost of computing power. Users will be able to enter cues such as 'sword strikes' or 'crisp bird chirps' to get corresponding audio clips, or generate background music with specific melodies and rhythms. The open-source version of Sora Opera will be available in the cloud after a period of time, and users can use video sound effects, BGM, and text-generated sound effects at will.
Founder Tulagu showed several demo videos of Sora Opera that were originally muted and processed to add sound effects, including the sounds of mammoths and small animal calls.
The pro version of Sora Opera is said to support up to 60 minutes of video dubbing, and users can also re-import footage they've shot into the tool to gain new sound effects and inspiration.
In addition, Sora Opera has a number of special features, including re-dubbing AI-generated videos, processing accelerated video content to match sound effects, recognizing image rhythms, and processing non-screen sounds. This new tool will provide more possibilities for video production and may also have an impact on traditional PPT presentations in the future.
Experience URL:https://soraopera.skymaper.com