Auki Labs, a company dedicated to producing sharable AR experiences, has released a short demo that showcases a breathtaking AR prototype capable of tracking hand and finger movements. Using a proprietary code written by Auki Labs and Matterless, creators of digital AR companions, the prototype is able to recognize various hand gestures and apply a variety of magic-looking effects accordingly, allowing the user to create visual effects with a wave of a hand.
According to the developers, the experience uses a monocular hand tracker using only the RGB feed from the camera to reconstruct the hand in 3D, developed by Zhongpai Gao, and doesn't require a LiDAR sensor to understand depth. At the moment, the prototype only works on iOS.
And here's one more demo shared by Auki Labs:
