Real-Time 3D Artist Ayoub Attache, who previously demonstrated a neat setup that allowed the artist to interact with a music player UI using hand motions, has shared a look at one more awesome project that enables its creator to control a virtual simulation with a physical object.
This time, the artist has managed to fly an F-15 Fighter Jet in Unreal Engine 5 with nothing but a phone, making it so that the plane moves in accordance with the phone's position. Achieved with sensor fusion and UE Marketplace's assets made by Vigilante, the setup sends data through a UDP socket over Wi-Fi, allowing Ayoub to fully control the plane and even trigger missiles and landing gear by pressing touchscreen buttons.