This AR Prototype Can Recognize Finger Gestures Without LiDAR

Auki Labs, a company dedicated to producing sharable AR experiences, has released a short demo that showcases a breathtaking AR prototype capable of tracking hand and finger movements. Using a proprietary code written by Auki Labs and Matterless, creators of digital AR companions, the prototype is able to recognize various hand gestures and apply a variety of magic-looking effects accordingly, allowing the user to create visual effects with a wave of a hand.

According to the developers, the experience uses a monocular hand tracker using only the RGB feed from the camera to reconstruct the hand in 3D, developed by Zhongpai Gao, and doesn't require a LiDAR sensor to understand depth. At the moment, the prototype only works on iOS.

And here's one more demo shared by Auki Labs:

You can learn more by visiting Auki Labs' official Twitter page. Also, don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more.