YouTube will add AI-generated dubs for videos
YouTube already offers a dubbing system, with video creators being able to offer more than one audio track. This concerns only a few YouTubers in the state, including MrBeast. Soon, the service will offer AI-generated voiceovers.
YouTube took advantage of VidCon to announce the call on the team of Aloud, an AI-based dubbing service from Google’s Area 120 incubator. Their tool first transcribes the video and gives the videographer a transcript that they can review and edit if needed. Then, the tool does the translation into the other languages and produces the dubbing. The video below explains how it works.
The video platform is already testing the tool with hundreds of creators, as YouTube’s Amjad Hanif announced at The Verge. He clarified that Aloud currently supports a few languages with more to come. As it stands, Aloud is available in English, Spanish, and Portuguese. Other languages will therefore arrive later, but there is no date or list yet.
Of course, the idea is that everyone can watch a video and understand it. YouTube’s AI dubbing somehow breaks down the language barrier.
Ultimately, YouTube “strives to make translated audio tracks sound like the voice of the creator, with more expression and lip-sync”, explains Amjad Hanif. These features are planned for 2024. In the meantime, the video below features an AI-generated Spanish dub. Click the gear to choose Spanish as the language.
