Multi-layered see-through movie in diminished reality

Yuko Uematsu, Takanori Hashimoto, Takuya Inoue, Naoki Shimizu, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents generating a multi-layered see-through movie for an auto-stereoscopic display. This work is based on Diminished Reality (DR), which is one of the research fields of Augmented Reality (AR). In the usual AR, some virtual objects are added on the real world. On the other hand, DR removes some real objects from the real world. Therefore, the background is visualized instead of the real objects (obstacles) to be removed. We use multiple color cameras and one TOF depth camera. The areas of obstacles are defined by using the depth camera based on the distance of obstacles. The background behind the obstacles is recovered by planarprojection of multiple cameras. Then, the recovered background is overlaid onto the removed obstacles. For visualizing it through the auto-stereoscopic display, the scene is divided into multiple layers such as obstacles and background. The pixels corresponding to the obstacles are not visualized or visualized semi-transparently at the center viewpoints. Therefore, we can see that the obstacles are diminished according to the viewpoints.

Original languageEnglish
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
Volume8288
DOIs
Publication statusPublished - 2012
EventStereoscopic Displays and Applications XXIII - Burlingame, CA, United States
Duration: 2012 Jan 232012 Jan 25

Other

OtherStereoscopic Displays and Applications XXIII
CountryUnited States
CityBurlingame, CA
Period12/1/2312/1/25

Fingerprint

Cameras
Augmented reality
Camera
Display devices
cameras
Autostereoscopic Display
Augmented Reality
Pixels
Color
virtual reality
Pixel
pixels
color
Background
Object

Keywords

  • Auto-stereoscopic display
  • Diminished Reality (DR)
  • multiple cameras
  • TOF depth camera

ASJC Scopus subject areas

  • Applied Mathematics
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics

Cite this

Uematsu, Y., Hashimoto, T., Inoue, T., Shimizu, N., & Saito, H. (2012). Multi-layered see-through movie in diminished reality. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 8288). [828825] https://doi.org/10.1117/12.910076

Multi-layered see-through movie in diminished reality. / Uematsu, Yuko; Hashimoto, Takanori; Inoue, Takuya; Shimizu, Naoki; Saito, Hideo.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 8288 2012. 828825.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Uematsu, Y, Hashimoto, T, Inoue, T, Shimizu, N & Saito, H 2012, Multi-layered see-through movie in diminished reality. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 8288, 828825, Stereoscopic Displays and Applications XXIII, Burlingame, CA, United States, 12/1/23. https://doi.org/10.1117/12.910076
Uematsu Y, Hashimoto T, Inoue T, Shimizu N, Saito H. Multi-layered see-through movie in diminished reality. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 8288. 2012. 828825 https://doi.org/10.1117/12.910076
Uematsu, Yuko ; Hashimoto, Takanori ; Inoue, Takuya ; Shimizu, Naoki ; Saito, Hideo. / Multi-layered see-through movie in diminished reality. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 8288 2012.
@inproceedings{045f0f180d9a444686d9005a95fb960c,
title = "Multi-layered see-through movie in diminished reality",
abstract = "This paper presents generating a multi-layered see-through movie for an auto-stereoscopic display. This work is based on Diminished Reality (DR), which is one of the research fields of Augmented Reality (AR). In the usual AR, some virtual objects are added on the real world. On the other hand, DR removes some real objects from the real world. Therefore, the background is visualized instead of the real objects (obstacles) to be removed. We use multiple color cameras and one TOF depth camera. The areas of obstacles are defined by using the depth camera based on the distance of obstacles. The background behind the obstacles is recovered by planarprojection of multiple cameras. Then, the recovered background is overlaid onto the removed obstacles. For visualizing it through the auto-stereoscopic display, the scene is divided into multiple layers such as obstacles and background. The pixels corresponding to the obstacles are not visualized or visualized semi-transparently at the center viewpoints. Therefore, we can see that the obstacles are diminished according to the viewpoints.",
keywords = "Auto-stereoscopic display, Diminished Reality (DR), multiple cameras, TOF depth camera",
author = "Yuko Uematsu and Takanori Hashimoto and Takuya Inoue and Naoki Shimizu and Hideo Saito",
year = "2012",
doi = "10.1117/12.910076",
language = "English",
isbn = "9780819489357",
volume = "8288",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",

}

TY - GEN

T1 - Multi-layered see-through movie in diminished reality

AU - Uematsu, Yuko

AU - Hashimoto, Takanori

AU - Inoue, Takuya

AU - Shimizu, Naoki

AU - Saito, Hideo

PY - 2012

Y1 - 2012

N2 - This paper presents generating a multi-layered see-through movie for an auto-stereoscopic display. This work is based on Diminished Reality (DR), which is one of the research fields of Augmented Reality (AR). In the usual AR, some virtual objects are added on the real world. On the other hand, DR removes some real objects from the real world. Therefore, the background is visualized instead of the real objects (obstacles) to be removed. We use multiple color cameras and one TOF depth camera. The areas of obstacles are defined by using the depth camera based on the distance of obstacles. The background behind the obstacles is recovered by planarprojection of multiple cameras. Then, the recovered background is overlaid onto the removed obstacles. For visualizing it through the auto-stereoscopic display, the scene is divided into multiple layers such as obstacles and background. The pixels corresponding to the obstacles are not visualized or visualized semi-transparently at the center viewpoints. Therefore, we can see that the obstacles are diminished according to the viewpoints.

AB - This paper presents generating a multi-layered see-through movie for an auto-stereoscopic display. This work is based on Diminished Reality (DR), which is one of the research fields of Augmented Reality (AR). In the usual AR, some virtual objects are added on the real world. On the other hand, DR removes some real objects from the real world. Therefore, the background is visualized instead of the real objects (obstacles) to be removed. We use multiple color cameras and one TOF depth camera. The areas of obstacles are defined by using the depth camera based on the distance of obstacles. The background behind the obstacles is recovered by planarprojection of multiple cameras. Then, the recovered background is overlaid onto the removed obstacles. For visualizing it through the auto-stereoscopic display, the scene is divided into multiple layers such as obstacles and background. The pixels corresponding to the obstacles are not visualized or visualized semi-transparently at the center viewpoints. Therefore, we can see that the obstacles are diminished according to the viewpoints.

KW - Auto-stereoscopic display

KW - Diminished Reality (DR)

KW - multiple cameras

KW - TOF depth camera

UR - http://www.scopus.com/inward/record.url?scp=84860197022&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860197022&partnerID=8YFLogxK

U2 - 10.1117/12.910076

DO - 10.1117/12.910076

M3 - Conference contribution

SN - 9780819489357

VL - 8288

BT - Proceedings of SPIE - The International Society for Optical Engineering

ER -