July 18th.Adobe Announcing a new series of generative AI Movie & TV Production ToolsThe newest addition to the program is a new way for creators to have more fun and efficient control over their sound creation and video generation.
1AI notes that Adobe's newly launched Generate Sound Effects The tool is currently being Firefly The app, which is in beta, can be used for both recorded and generated video clips and has more control over audio generation than Google's Veo 3 video tool. The interface is similar to a video editing timeline, allowing users to precisely match the sound effects they create to uploaded video clips. For example, a user can play a video of a horse walking on a road and record a "clatter" synchronized with the pace of the horse's hooves, along with a text description that says "horse's hooves on concrete," and the tool generates four sound effects for the user to choose from. This feature builds on the Project Super Sonic experiments Adobe demonstrated at its Max event last October, and while it doesn't yet support voice generation, it already creates impact sounds such as tree branches breaking, footsteps, and zippers, as well as ambient sounds such as nature sounds and urban atmospheres.
In addition to the sound creation tools, Adobe has introduced new advanced controls for the Firefly text-to-video generator that further enhance the flexibility and precision of video generation.
The Composition Reference feature allows users to upload a video as a reference and Firefly will mimic the composition of that reference video when generating the video. This feature makes it easier for creators to achieve a specific look without having to repeatedly enter text descriptions.
The Keyframe Cropping feature allows users to crop and upload the first and last frames of a video, and Firefly will generate intermediate video content based on those keyframes.
Adobe has also added a range of style presets to the Firefly video generator, including anime, vector art, claymation, and other visual styles that creators can quickly select and apply. However, these style presets currently only support Adobe's own Firefly video AI models. While some of the styles (such as "Claymation") still need to be improved in real-world demos, Adobe is making continuous improvements and plans to support more third-party AI models in the future.