Controlling a Plane in Unreal Engine 5 With a Phone

Real-Time 3D Artist Ayoub Attache, who previously demonstrated a neat setup that allowed the artist to interact with a music player UI using hand motions, has shared a look at one more awesome project that enables its creator to control a virtual simulation with a physical object.

This time, the artist has managed to fly an F-15 Fighter Jet in Unreal Engine 5 with nothing but a phone, making it so that the plane moves in accordance with the phone's position. Achieved with sensor fusion and UE Marketplace's assets made by Vigilante, the setup sends data through a UDP socket over Wi-Fi, allowing Ayoub to fully control the plane and even trigger missiles and landing gear by pressing touchscreen buttons.

You can learn more about the project here. Also, don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more.