logo80lv
Articlesclick_arrow
Research
Talentsclick_arrow
Events
Workshops
Aboutclick_arrow
profile_loginLogIn

Cool Time-Based Media Visualizations With Gestures

Powered by TouchDesigner.

Multidisciplinary Artist Kat Zhang, who refers to her works as "poetic engineering", creates multi-sensory experiences investigating how computation can reveal the unconscious and poetic aspects of the human and machine psyche. Recently, she has been conducting gesture-based experiments, pushing the boundaries of her artistic practice with the goal of building tools that "manipulate symbolic thinking in an embodied and intuitive way".

For this series of works using hands to explore latent spaces, Kat Zhang utilized Torin Blankensmith's MediaPipe plug-in for Derivative's TouchDesigner, which supports face, hand, pose, and object tracking with multi-person face detection, object detection, and image segmentation/background removal:

Currently, all of these projects are self-funded, and if you'd like to support Kat Zhang and her fascinating science art, consider becoming a subscriber on Substack here:

On the topic of hand gestures-based systems, earlier this year, Steven Mark Kübler presented a setup that utilizes an Arduino-based controller alongside TouchDesigner to enable its creator to manipulate digital particles through hand movements:

And shortly after that, Vasant Verma also managed to control particles with hand motions, leveraging the MediaPipe plug-in and TouchDesigner:

Follow Kat Zhang's Instagram for more visual works and join our 80 Level Talent platform and our Telegram channel, follow us on InstagramTwitterLinkedInTikTok, and Reddit, where we share breakdowns, the latest news, awesome artworks, and more.

The pack includes sky photos for photobashing and matte painting (250 photos, variety of weather, up to 6000x4000px).

Error
(2000-0001)

Join discussion

Comments 0

    You might also like

    A Week After "Basically Announcing" Minecraft 2, Notch Basically Cancels It

    Instead, he and his team will focus on the previously-announced retro-style roguelike.

    Discord Gets Sued Over Alleged Anti-Consumer Practices

    The plaintiffs claim the platform has intentionally made it overly difficult to cancel subscriptions.

    Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

    A video game store from Uruguay appears to have disclosed the launch date for the gaming industry's most anticipated title.
    • Camping and Outdoor Props
      by Dekogon

      This project includes assets, maps, materials, Blueprints, and effects created in the Unreal Engine. Each asset was created for realistic AAA quality visuals, style, and budget.

      Error
      (2000-0001)
    • Concrete Floor
      by Stan Brown

      100% procedural Material made in Substance Designer

      Error
      (2000-0001)

    We need your consent

    We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more

    ×