YouTube tests AI lip-syncing feature for auto-dubs with potential paid access for creators

YouTube is piloting an AI lip-syncing tool that enhances auto-dubs and may become a paid feature for creators

YouTube is testing a new artificial intelligence-powered lip-syncing tool designed to enhance its existing auto-dubbing feature, according to a report by Digital Trends. The feature aims to make dubbed videos appear more natural by aligning creators’ lip movements with translated audio in real time.

Buddhika Kottahachchi, YouTube’s Product Lead for Autodubbing, explained that the technology works by “modifying the pixels on the screen to match the translated speech.” He added that the system depends on a 3D understanding of facial elements such as lip shapes, teeth, and posture to produce realistic synchronization.

Currently, the AI lip-sync system is optimized for 1080p resolution, though YouTube plans to expand it to 4K and more languages over time. Kottahachchi noted that YouTube’s long-term goal is to support over 20 languages, similar to the platform’s auto-dubbing tool. However, he cautioned that the project remains in its early testing phase and is currently limited to a select group of trusted creators.

The YouTube executive also hinted that the feature could eventually come with an additional fee. The company is reportedly assessing the system’s compute requirements before deciding whether creators will be charged for access. “We are not ready to make any broad statements about how broadly we will make it available,” Kottahachchi said, emphasizing that quality and scalability are top priorities.

The development aligns with YouTube’s broader integration of artificial intelligence across its ecosystem. Other recent AI-driven tools include automatic Shorts generation, ad placement optimization, and VEO 3, the platform’s video creation model.

If fully implemented, the AI lip-syncing feature could significantly enhance global accessibility for creators and audiences alike, though it may come at an added cost.