August 24th.Meta One has now been formally announced Reels Short VideoAudiotranslateThe first batch of the function on Facebook and Instagram platforms, mainly utilizing AI to automatically translate the voice of characters in short videos into different languages, this function can significantly reduce the cost of production of multilingual videos and help creators who already have multilingual content to distribute their works more efficiently.
According to the introduction,The corresponding AI model supports mouth alignment and synchronized translation of two-person conversations.At the same time, you can synthesize a translation track that is similar to your own voice according to the timbre characteristics of both parties for differentiated segmentation, making the video performance more natural.
1AI notes that the corresponding function only supports English and Spanish for the time being, and the official recommendation is for creators to use "direct content" facing the camera when filming, to maintain clear pronunciation and reduce background noise, in order to improve the accuracy of the translation synchronized with the shape of the mouth.
In addition to automatic translation, Meta offers a multi-language audio track upload option for Facebook, which allows creators to upload up to 20 different language tracks for a single video through the Meta Business Suite's Reels editor, labeled with a language category, which can be added, deleted, or replaced before or after publishing, and viewers will automatically play the corresponding version based on their language settings. The corresponding tracks can be added, deleted, or replaced before or after publishing, and viewers will automatically play the corresponding versions according to their language settings.