Daniel Beauchamp, a renowned AR enthusiast and Principal AR/VR Engineer at Shopify, has really one-upped himself this time, showcasing an absolutely jaw-dropping setup that combines 3D modeling and augmented reality into one seamless experience.
Operating on the Apple Vision Pro headset, this setup allows users to preview 3D Blender scenes in AR in real-time by continuously exporting USDZ files. Thanks to Apple's Reality Kit, the system can utilize the user's real-life surroundings as a light source, consistently updating the environment map to reflect changes and enable realistic light interactions with the AR version of a 3D model. According to the author, the setup is scheduled to go open-source in the coming weeks and will be available via Shopify.