You Can Interact with Game World Using Your Hands & Breath in This Project
Zlata Zuieva shows an interesting gesture-based concept.
Manipulating reality with hand tracking has been on the rise lately, and Zlata Zuieva has another experiment set up in Unity, which not only uses hands but also your breath.
In her gesture-based interaction project, she walks to a book using her fingers and actually blows hot air on it to melt the ice on the virtual prop.
"The main principle is simple: the player finds a frozen diary in the winter forest, opens it by moving their hands to simulate opening the diary, and uncovers words by blowing on them as if melting ice. Stop blowing – book is getting frozen again."
Zlata Zuieva
Hand tracking was performed using MediaPipe plugins in Unity, while the book-opening process is influenced by the distance between the hand landmarks, which is mapped to the blend value of the opening animation, according to the creator. The blowing interaction is made through real-time microphone inputs, and the visual effects for the frosted pages are processed using a customized shader.
"This project was primarily an exploration of alternative input methods and UX feel," Zuieva said. We can expect more curious works from her, so check out her LinkedIn to stay in touch.
Also, have a look at similar projects by Ian Curtis, Vasant Verma, Steven Mark Kübler, Kat Zhang, and David Katz.
Don't forget to subscribe to our Newsletter and join our 80 Level Talent platform, follow us on Twitter, LinkedIn, Telegram, and Instagram, where we share breakdowns, the latest news, awesome artworks, and more.
