Illumination estimation and relighting using an RGB-D camera

Yohei Ogura, Takuya Ikeda, Francois De Sorbier, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this paper, we propose a relighting system combined with an illumination estimation method using RGBD camera. Relighting techniques can achieve the photometric registration of composite images. They often need illumination environments of the scene which include a target object and the background scene. Some relighting methods obtain the illumination environments beforehand. In this case, they cannot be used under the unknown dynamic illumination environment. Some on-line illumination estimation methods need light probes which can be invade the scene geometry. In our method, the illumination environment is estimated from pixel intensity, normal map and surface reflectance based on inverse rendering in on-line processing. The normal map of the arbitrary object which is used in the illumination estimation part and the relighting part is calculated from the denoised depth image on each frame. Relighting is achieved by calculating the ratio for the estimated Illumination environment of the each scene. Thus our implementation can be used for dynamic illumination or a dynamic object.

Original languageEnglish
Title of host publicationVISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings
EditorsJose Braz, Sebastiano Battiato, Francisco Imai
PublisherSciTePress
Pages305-312
Number of pages8
ISBN (Electronic)9789897580901
DOIs
Publication statusPublished - 2015
Event10th International Conference on Computer Vision Theory and Applications, VISAPP 2015 - Berlin, Germany
Duration: 2015 Mar 112015 Mar 14

Publication series

NameVISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings
Volume2

Other

Other10th International Conference on Computer Vision Theory and Applications, VISAPP 2015
CountryGermany
CityBerlin
Period15/3/1115/3/14

Keywords

  • Illumination estimation
  • RGB-D camera
  • Relighting

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Illumination estimation and relighting using an RGB-D camera'. Together they form a unique fingerprint.

  • Cite this

    Ogura, Y., Ikeda, T., De Sorbier, F., & Saito, H. (2015). Illumination estimation and relighting using an RGB-D camera. In J. Braz, S. Battiato, & F. Imai (Eds.), VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings (pp. 305-312). (VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications; VISIGRAPP, Proceedings; Vol. 2). SciTePress. https://doi.org/10.5220/0005295403050312