Rcam2 is my second attempt at a real-time volumetric AR VFX system with Unity (the first attempt is Rcam). This time I used iPad Pro with a LiDAR scanner.
The Rcam2 system consists of two software components: RcamController and RcamVisualizer. RcamController runs on an iPad device and sends a video stream and metadata (camera position, control data, etc.) to RcamVisualizer, which runs on a desktop computer and renders VFX. It uses NDI to communicate between these two components, so it doesn't require any special hardware but only a network connection
I used Rcam2 in a Boiler Room stream on 24th September 2020. You can watch the recorded video on YouTube.
- Unity 2020.1.6
- iPad Pro with LiDAR scanner (2020 model)
- iOS 14 and Xcode 12
- NDI SDK 4.5
- Unity 2020.1.6
- HDRP-compatible desktop system
- Build and run the RcamController project on the iPad device.
- Play the RcamVisualizer project on the desktop system.
- Select a controller from the dropdown list. You can hide the UI by clicking an empty area of the screen.