Neural Methods for Reconstruction and Rendering of Real World Scenes

Christian Theobalt

(Max-Planck-Institute for Informatics)

Please LOG IN to view the video.

Date: November 17, 2021


In this presentation, I will talk about some of the recent work we did on new methods for reconstructing computer graphics models of real world scenes from sparse or even monocular video data. These methods are based of bringing together neural network-based and explicit model-based approaches. I will also talk about new neural rendering approaches that combine explicit model-based and neural network based concepts for image formation in new ways. They enable new means to synthesize highly realistic imagery and videos of real work scenes under user control.

Further Information:

Christian Theobalt is the Scientific Director of the new Visual Computing and Artificial Intelligence Department at the Max-Planck-Institute for Informatics, Saarbrücken, Germany. He is also a Professor of Computer Science at Saarland University, Germany. From 2007 until 2009 he was a Visiting Assistant Professor in the Department of Computer Science at Stanford University. He received his MSc degree in Artificial Intelligence from the University of Edinburgh, his Diplom (MS) degree in Computer Science from Saarland University, and his PhD (Dr.-Ing.) from the Max-Planck-Institute for Informatics.
In his research he looks at algorithmic problems that lie at the intersection of Computer Graphics, Computer Vision and Machine Learning, such as: static and dynamic 3D scene reconstruction, neural rendering and neural scene representations, marker-less motion and performance capture, virtual humans, virtual and augmented reality, computer animation, intrinsic video and inverse rendering, computational videography, machine learning for graphics and vision, new sensors for 3D acquisition, as well as image- and physically-based rendering. He is also interested in using reconstruction techniques for human computer interaction. For his work, he received several awards, including the Otto Hahn Medal of the Max-Planck Society in 2007, the EUROGRAPHICS Young Researcher Award in 2009, the German Pattern Recognition Award 2012, and the Karl Heinz Beckurts Award in 2017, and the EUROGRAPHICS Outstanding Technical Contributions Award in 2020. He received two ERC grants, an ERC Starting Grant in 2013 and an ERC Consolidator Grant in 2017.

Created: Thursday, November 18th, 2021