Real-Time 3D Artist Ayoub Attache has demonstrated a marvelous setup that allows the artist to interact with a music player UI using hand motions. According to the artist, the UI is custom-made and was inspired by Ceptari Tyas, Gleb Kuznetsov, and Piqo Design's works. The setup responds to a variety of gestures, including left, right, up, and down movements to move around the screen, double-clicks to play, pause, and select songs, and index finger waving to increase and decrease the volume.
The project's description states that the demo uses Mediapipe hand-tracking framework integrated with Unreal Engine 5. The tracking data comes from the phone and is transmitted over a TCP server.
