LogInLearn how Scott Mann's box-office flop Heist inspired him to create an AI tool designed to create lip-synced versions of movies and other content in multiple languages.
A London-based tech startup named Flawless has released a new tool that can potentially change the dubbing process of movies and other media. Using AI and neural networks, the tool can simulate lip movements in different languages.
Scott Mann, the Co-Founder of Flawless and a Director of a 2015 Heist movie came up with this idea during filming the aforementioned movie. He said that the dubbing killed the performance of Robert De Niro and thus, Mann decided to find a solution that would change the dubbing process. And found it he did.
In collaboration with the Max Planck Institute in Germany, Scott created the tool. The process begins with recording an actor speaking the dialog in the required language. The new audio and picture would then be delivered to Flawless, which would effectively use its AI-driven system to create a lip-synced picture. Mann says it is largely an automated process of retiming mouth movement. After that, the Special Effects Artists would polish the result and deliver the final version to the client.
The possibilities opened with this new tool can be seen down below:
Learn more about the next step in the dubbing industry by visiting Flawless' website. Also, don't forget to join our new Telegram channel, our Discord, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.