The creator showed how Unity VFX Graph and the Virtual Camera companion app can be used for medical purposes.
Senior Partner Engineer at Unity Roy Rodenhaeuser has unveiled a new mind-blowing project that demonstrates how Virtual Production tools, common for 3D Artists and Game Developers, can be used for medical purposes.
The developer has managed to turn an iPad into a machine capable of "slicing" CT scan data utilizing Unity VFX Graph, which turns textures made from the scanned images into a volume of particles, and the Virtual Camera companion app, allowing one to view x-ray images layer by layer. According to the creator, the prototype also uses the iPad's LiDAR scanner for position tracking.
"I used a C# script to sample the DICOM image files into a 3D Texture before turning these into a volume of millions of particles with VFX Graph," commented Roy. "The results are then viewed in real-time using an iPad Pro equipped with LiDAR which offers better position tracking."