Multi-layered see-through movie in diminished reality

Yuko Uematsu, Takanori Hashimoto, Takuya Inoue, Naoki Shimizu, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents generating a multi-layered see-through movie for an auto-stereoscopic display. This work is based on Diminished Reality (DR), which is one of the research fields of Augmented Reality (AR). In the usual AR, some virtual objects are added on the real world. On the other hand, DR removes some real objects from the real world. Therefore, the background is visualized instead of the real objects (obstacles) to be removed. We use multiple color cameras and one TOF depth camera. The areas of obstacles are defined by using the depth camera based on the distance of obstacles. The background behind the obstacles is recovered by planarprojection of multiple cameras. Then, the recovered background is overlaid onto the removed obstacles. For visualizing it through the auto-stereoscopic display, the scene is divided into multiple layers such as obstacles and background. The pixels corresponding to the obstacles are not visualized or visualized semi-transparently at the center viewpoints. Therefore, we can see that the obstacles are diminished according to the viewpoints.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII
DOIs
Publication statusPublished - 2012 Apr 30
EventStereoscopic Displays and Applications XXIII - Burlingame, CA, United States
Duration: 2012 Jan 232012 Jan 25

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8288
ISSN (Print)0277-786X

Other

OtherStereoscopic Displays and Applications XXIII
CountryUnited States
CityBurlingame, CA
Period12/1/2312/1/25

    Fingerprint

Keywords

  • Auto-stereoscopic display
  • Diminished Reality (DR)
  • TOF depth camera
  • multiple cameras

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Uematsu, Y., Hashimoto, T., Inoue, T., Shimizu, N., & Saito, H. (2012). Multi-layered see-through movie in diminished reality. In Proceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Applications XXIII [828825] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8288). https://doi.org/10.1117/12.910076