Using Hand Motions to Interact With a Music Player UI

Real-Time 3D Artist Ayoub Attache has demonstrated a marvelous setup that allows the artist to interact with a music player UI using hand motions. According to the artist, the UI is custom-made and was inspired by Ceptari Tyas, Gleb Kuznetsov, and Piqo Design's works. The setup responds to a variety of gestures, including left, right, up, and down movements to move around the screen, double-clicks to play, pause, and select songs, and index finger waving to increase and decrease the volume.

The project's description states that the demo uses Mediapipe hand-tracking framework integrated with Unreal Engine 5. The tracking data comes from the phone and is transmitted over a TCP server.

Click here to learn more about the project. Also, don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.