The two companies created a new real-time pipeline, from design to performance capture with live, on-stage AR delivery.
Alter Ego is a brand new singing competition hosted by Rocsi Diaz currently airing on Fox. Instead of the performers appearing physically, a combination of advanced performance capture technology and AR tools allows the performers to drive the movement of their digital avatars on stage, in real-time.
Part of the process included developing special effects such as the ability to cry, blush, and sweat in real-time. To bring these avatars to life, Silver Spoon set up a full motion capture volume on set, matching the size of the physical stage on which the AR avatars would appear. Each performer’s body and face were captured in precise detail and translated, in real-time via lulu’s AR compositing tools, to their digital alter ego performing on stage.
"The technology and creative process behind Alter Ego are unique and ground-breaking," says Laura Herzing, Executive Producer at Silver Spoon. "From the performance capture and Unreal integration to live compositing and real-time controls, every step builds upon the last. The success of this novel real-time pipeline is a testament to the capabilities of everyone involved. As a result, we expect the concept of virtual avatars and performances to continue growing as an established form of live entertainment.”
Don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.