Detour Light Field Rendering for Diminished Reality Using Unstructured Multiple Views

Shohei Mori, Momoko Maezawa, Naoto Ienaga, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Instructor's perspective videos are useful for presenting intuitive visual instructions for trainees in medical and industrial settings. In such videos, the instructor's arms often obstruct the trainee's view of the work area. In this article, we present a diminished reality method for visualizing the work area hidden by an instructor's arms by capturing the work area with multiple cameras. To achieve such diminished reality, we propose detour light field rendering (DLFR), in which light rays avoid passing through penalty points set in the unstructured light fields reconstructed from multiple viewpoint images. In DLFR, the camera blending field used in an existing freeviewpoint image generation method known as unstructured lumigraph is re-designed based on our use cases. In this re-design, lesser weights are given to light rays as they pass close to given penalty points. Experimental results demonstrate that using DLFR, the appearance of an undesirable object can be removed from an image in real time.

Original languageEnglish
Title of host publicationAdjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages292-293
Number of pages2
ISBN (Electronic)9781509037407
DOIs
Publication statusPublished - 2017 Jan 30
Event15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016 - Merida, Yucatan, Mexico
Duration: 2016 Sep 182016 Sep 23

Other

Other15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016
CountryMexico
CityMerida, Yucatan
Period16/9/1816/9/23

Keywords

  • Computational Photography
  • Diminished Relity
  • Light Field Rendering
  • Multiple Views

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction
  • Media Technology
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Detour Light Field Rendering for Diminished Reality Using Unstructured Multiple Views'. Together they form a unique fingerprint.

  • Cite this

    Mori, S., Maezawa, M., Ienaga, N., & Saito, H. (2017). Detour Light Field Rendering for Diminished Reality Using Unstructured Multiple Views. In Adjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016 (pp. 292-293). [7836519] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR-Adjunct.2016.0098