Jakarta, INTI – Language barriers often pose challenges for content creators aiming to reach international audiences. Addressing this, Meta has officially launched an AI-powered voice dubbing feature on Reels worldwide. The feature allows users to translate their voices into other languages with an added lip-sync option, ensuring mouth movements align naturally with the translation. This technology was first introduced by Mark Zuckerberg at Meta Connect 2024.
Initial Translation Between English and Spanish
In its initial phase, the feature supports translations from English to Spanish and vice versa, with Meta assuring support for additional languages soon. Currently, the feature is available to Facebook creators with over 1,000 followers, while all public Instagram accounts can use it immediately.
Natural Voice Technology and Lip-Sync
The feature works by training on the user’s original voice and generating translated audio tracks that preserve tone and intonation. The lip-sync option adjusts mouth movements to match the translation, creating a natural appearance. Users can select the “Translate your voice with Meta AI” menu before uploading Reels, add lip-sync, and review the AI-generated translation before publishing. Viewers will see a pop-up indicating that the audio has been AI-translated.
Usage Guidelines and Content Optimization
Meta recommends using the feature for face-to-camera videos for optimal results. Creators are advised not to cover their mouths or use excessive background music. The technology supports up to two speakers, though overlapping speech should be avoided. With this feature, creators can more effectively expand their reach to audiences across different languages.
Monitoring Content Performance by Language
Meta also provides performance data by language, enabling creators to track the effectiveness of their content in different languages. This launch adds to a growing list of major platforms offering similar technology; previously, YouTube released AI dubbing features, and Apple introduced live translation in Messages, Phone, and FaceTime on iOS 26.
Conclusion: AI
The AI voice dubbing feature on Reels makes it easier for creators to reach international audiences without language limitations. Combining advanced translation technology with natural lip-sync, it delivers a more interactive and inclusive viewing experience while supporting global content expansion.
Read More:Students Create Smart Glasses to Help the Visually Impaired Detect Medication