Hi Elliott, This is a great breakdown and very generous in sharing your process and insights, you came a long way from the vending machine days!
Are you planning on releasing the UE4 project to the public? Or only builds? I'd love to play around with it in the editor if possible!
Infinite-Realities has demonstrated its Aeon 4D scanning system: a synchronized 6K multi-machine vision camera array (global shutter) recording at 30 FPS. The developers state that the project is really close to becoming a commercial reality. The recorded data was reconstructed with Agisoft Photoscan and is being played in Unity at up to 250 FPS, buffered, VR ready. This technology can definitely push the boundaries of VR and filmmaking.
Our system is a little different to the others as it does not rely on green screen silhouette reconstruction, no active scanning, no stereo pairs or low end USB cameras. We came at this problem from the hardest possible angle. High-end, high resolution per pixel reconstruction using machine vision and modern software tools like Agisoft Photoscan or Capturing Reality. We use cameras that can record RAW footage (at up to 12-Bit) at 6K resolution, streamed to disk at up to 3.4GB/s. Our base line capture rate is 30fps but we can also shoot at 60fps or 120fps depending on ROI used. Higher frame rates will reduce capture resolution.
This has been a huge technical challenge, something that has taken us over 5 years to solve since our early days in human scanning 10 years ago. It’s also been expensive to develop on our own.
..we dream of using USB point grey cameras at 2K resolution.. but that would be far to easy!
Our 6K cameras in resolution comparison to 2K
Terms that have appeared over the last few years in relation to this field. Motion scanning, 4D, volumetric capture, holographic, video scanning, videogrammetry, lightfields. All are equally relevant.
Here’s a typical example of an “InsideOut” Lightfield capture system, similar to what Facebook showcased recently
So we reversed that and we’ve designed and built our own “OutsideIn” 4D Motion Scanning System, part IR, part IDA-Tronic in design.
You can find more information on the presented project here.