YouTube officially rolled out its AI-powered auto-dubbing feature to a broader audience on December 10, 2024. Initially tested with select creators after its introduction at Vidcon last year, this tool is now available to hundreds of thousands of channels focusing on knowledge-based content, such as cooking tutorials and DIY projects.
Read also: YouTube on your TV? Airtel Nigeria teams up with Google to convert analogue TVs into smart screens
How YouTube enhances accessibility with auto-dubbing
The feature is designed to make content accessible to global audiences by automatically generating audio tracks in multiple languages. Upon uploading a video, creators can benefit from automatic language detection and translation. Supported languages currently include English, French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish, with more to be added in the future.
The technology behind YouTube’s new tool
YouTube’s auto-dubbing leverages Google’s Gemini AI technology, known for its ability to mimic human speech. While this innovation bridges language barriers, the feature remains in its infant stages, with occasional translation or dubbed voice representation inaccuracies. YouTube emphasises that creator feedback is vital for improving the tool’s performance.
Read also: YouTube bolsters deepfake detection tools
In addition to refining the auto-dubbing tool, YouTube plans to introduce an “Expressive Speech” update. This enhancement aims to replicate the creator’s tone, emotions, and even the ambience of their surroundings, offering a more immersive experience for viewers.
By expanding this feature, YouTube reinforces its commitment to making its content library inclusive and accessible. While it currently caters to knowledge-focused creators, the company has plans to extend the tool’s availability across other content categories, further cementing its global reach.