Amazon Prime Video Deploys AI-Powered Dubbing Tech to Harmonize Actors' Mouths

Amazon Prime Video is taking its streaming service to the next level with an AI-powered feature that synchronizes actors' mouth movements with dubbed dialogue. The tech, which was announced on Thursday, will initially be available exclusively for the English dub of the German series 'Maxton Hall,' but Amazon plans to expand it to other titles in the future.

The company claims this innovation will enhance the viewing experience by creating a more seamless and immersive way for customers to enjoy global content. According to Raf Soltanovich, Vice President of Technology at Prime Video and Amazon MGM Studios, 'At Prime Video, we're constantly innovating with new tools that enhance the viewing experience for our customers.'

This isn't the first time Amazon has experimented with AI-assisted dubbing; last year, it rolled out an experimental feature for a dozen movies and shows in English and Spanish. However, there are concerns about how this technology will be deployed, particularly regarding the potential overreach of Amazon's control over the presentation of works of art.

One worry is that actors' unique facial expressions may be smoothed down to create a generic look, rather than preserving the original performance. Additionally, it remains unclear how much of the feature is automated by AI and whether rightsholders will have any say in its deployment.