This AR Prototype Can Recognize Finger Gestures Without LiDAR

The prototype works on iOS and was developed by Auki Labs and Matterless.

Auki Labs, a company dedicated to producing sharable AR experiences, has released a short demo that showcases a breathtaking AR prototype capable of tracking hand and finger movements. Using a proprietary code written by Auki Labs and Matterless, creators of digital AR companions, the prototype is able to recognize various hand gestures and apply a variety of magic-looking effects accordingly, allowing the user to create visual effects with a wave of a hand.

According to the developers, the experience uses a monocular hand tracker using only the RGB feed from the camera to reconstruct the hand in 3D, developed by Zhongpai Gao, and doesn't require a LiDAR sensor to understand depth. At the moment, the prototype only works on iOS.

And here's one more demo shared by Auki Labs:

You can learn more by visiting Auki Labs' official Twitter page. Also, don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more. 

Join discussion

Comments 0

    You might also like

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more