The creator showed how Unity VFX Graph and the Virtual Camera companion app can be used for medical purposes.
Senior Partner Engineer at Unity Roy Rodenhaeuser has unveiled a new mind-blowing project that demonstrates how Virtual Production tools, common for 3D Artists and Game Developers, can be used for medical purposes.
The developer has managed to turn an iPad into a machine capable of "slicing" CT scan data utilizing Unity VFX Graph, which turns textures made from the scanned images into a volume of particles, and the Virtual Camera companion app, allowing one to view x-ray images layer by layer. According to the creator, the prototype also uses the iPad's LiDAR scanner for position tracking.
"I used a C# script to sample the DICOM image files into a 3D Texture before turning these into a volume of millions of particles with VFX Graph," commented Roy. "The results are then viewed in real-time using an iPad Pro equipped with LiDAR which offers better position tracking."
You can find Roy's original post here. Also, don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more.