Using iPad Pro & Unity to Transform Real-Life Objects in Real-Time

Mohamed Kari, Tobias Grosse-Puppendahl, Luis Falconeri Coelho, Andreas Rene Fender, David Bethge, Reinhard Schütte, and Christian Holz have presented a cool new technology at Ismar 2021. Meet TransforMR, a video see-through mixed reality system for mobile devices that performs 3D-pose-aware object substitution to create meaningful mixed reality scenes in previously unseen, uncontrolled, and open-ended real-world environments. The program uses Unity and 4 NVIDIA Tesla V100 GPUs to run and Apple iPad Pro, 12.9 inches, was used on-site by participants to explore the surroundings at their discretion.

You can learn more about the system here. Also, don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.