Prime Video Rolls Out AI Lip Sync for Dubbed Shows
Amazon's Prime Video has introduced an artificial intelligence feature that adjusts actors' lip movements to match human-dubbed English audio, beginning with the German-language series Maxton Hall. The lip-sync technology went live this week on the first two seasons of the show worldwide and will also be used for the third and final season, which premieres on Dec. 9. The feature combines AI and visual effects tools to modify the video itself after dialogue has been translated and recorded, so that the English audio aligns more closely with what viewers see on screen. Amazon said the technology works alongside human-recorded dubbing rather than replacing it, and is intended to address the disconnect that can occur when actors' mouths continue moving after dubbed dialogue has ended. Raf Soltanovich, Vice President of Technology at Prime Video and Amazon MGM Studios, said the company is constantly innovating with tools that enhance the viewing experience.