Using Hand Motions to Interact With a Music Player UI

The setup uses the Mediapipe plug-in and is powered by Unreal Engine 5.

Real-Time 3D Artist Ayoub Attache has demonstrated a marvelous setup that allows the artist to interact with a music player UI using hand motions. According to the artist, the UI is custom-made and was inspired by Ceptari Tyas, Gleb Kuznetsov, and Piqo Design's works. The setup responds to a variety of gestures, including left, right, up, and down movements to move around the screen, double-clicks to play, pause, and select songs, and index finger waving to increase and decrease the volume.

The project's description states that the demo uses Mediapipe hand-tracking framework integrated with Unreal Engine 5. The tracking data comes from the phone and is transmitted over a TCP server.

Click here to learn more about the project. Also, don't forget to join our new Reddit pageour new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.

Join discussion

Comments 0

    You might also like

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more