3D Designer 五天晴 used an OSC-based app to accomplish the task.
Chinese 3D Designer 五天晴 has managed to break the fourth wall between the artist and the project by figuring out an unorthodox way to illuminate parts of the scene using an iPhone. At first glance, it even seems that the project is being lit by the phone's flashlight.
To accomplish such a stunning feat, the artist used an OSC(Open Sound Control)-based app that detects the phone's motion using a gyroscope. The motion is then linked to a light source in Blender via a Blender OSC add-on, making it possible to move the phone and change the lighting. The result looks very impressive and can potentially be used by future artists and game developers to make their projects even more interactive.
You can learn more about the project here. Also, don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.