Epic Games revealed a new iOS app, Live Link Face for Unreal Engine, which is now available on the App Store.
The new application allows users to stream high-quality facial animation in real-time from iPhone directly onto characters in Unreal Engine. It uses Apple’s ARKit and the iPhone’s TrueDepth front-facing camera to interactively track a performer’s face, and then transmit this data directly to Unreal Engine via Live Link over a network. The app is meant for both professional capture stages with multiple actors in full motion capture suits and individual artists' desks allowing creators to capture expressive and emotive facial performances.
"Collaborative virtual production is a particular emphasis of the app, with multicast networking to stream Live Link data to all machines in the Multi-User Editor session simultaneously in order to minimize latency," wrote the team. "Robust timecode support and precise frame accuracy enable seamless synchronization with other stage components like cameras and body motion capture."
You can learn more about the new app here.