An Integrated 6DoF Video Camera and System Design
Albert Parra Pozo
(Facebook)
Please LOG IN to view the video.
Date: March 4, 2020
Description:
Designing a fully integrated 360◦ video camera supporting 6DoF head motion parallax requires overcoming many technical hurdles, including camera placement, optical design, sensor resolution, system calibration, real-time video capture, depth reconstruction, and real-time novel view synthesis. While there is a large body of work describing various system components, such as multi-view depth estimation, our paper is the first to describe a complete, reproducible system that considers the challenges arising when designing, building, and deploying a full end-to-end 6DoF video camera and playback environment. Our system includes a computational imaging software pipeline supporting online markerless calibration, high-quality reconstruction, and real-time streaming and rendering. Most of our exposition is based on a professional 16-camera configuration, which will be commercially available to film producers. However, our software pipeline is generic and can handle a variety of camera geometries and configurations. The entire calibration and reconstruction software pipeline along with example datasets is open sourced to encourage follow-up research in high-quality 6DoF video reconstruction and rendering.
Further Information:
Albert Para Pozo is the Tech Lead of the AR/VR Capture team that is responsible for developing next generation virtual and augmented reality technologies. Before joining Facebook in 2014, Albert received a PhD in Electrical and Computer Engineering from Purdue University, and a BS in Telecommunications Engineering from the Polytechnic University of Catalonia. His research interests include virtual reality, augmented reality, computational imaging and image processing.
Created: Wednesday, March 4th, 2020