VR 2017

2017 IEEE Virtual Reality (VR), March 18-22, 2017, Los Angeles, CA, USA

Desktop Layout

Research Demos
Terrace A/B
Rapid Creation of Photorealistic Virtual Reality Content with Consumer Depth Cameras
Chih-Fan Chen, Mark Bolas, and Evan Suma Rosenberg
(University of Southern California, USA)
Abstract: Virtual objects are essential for building environments in virtual reality (VR) applications. However, creating photorealistic 3D models is not easy, and handcrafting the detailed 3D model from a real object can be time and labor intensive. An alternative way is to build a structured camera array such as a light-stage to reconstruct the model from a real object. However, these technologies are very expensive and not practical for most users. In this work, we demonstrate a complete end-to-end pipeline for the capture, processing, and rendering of view-dependent 3D models in virtual reality from a single consumer-grade RGB-D camera. The geometry model and the camera trajectories are automatically reconstructed from a RGB-D image sequence captured offline. Based on the HMD position, selected images are used for real-time model rendering. The result of this pipeline is a 3D mesh with view-dependent textures suitable for real-time rendering in virtual reality. Specular reflections and light-burst effects are especially noticeable when users view the objects from different perspectives in a head-tracked environment.


Time stamp: 2019-05-22T10:24:06+02:00