Diminished reality using real-time region extraction with depth cameras

Naoki Shimizu, Takanori Hashimoto, Yuko Uematsu, Hideo Saito

Research output: Contribution to journalArticle

Abstract

In contrast with augmented reality (AR), diminished reality (DR) is a technique for removing or concealing real objects from the real world by overlaying a background onto an area with obstacles in captured images. We propose a real time DR system that is an extension of our previous DR system used in baseball games. Our proposed system consists of three colors cameras and one depth camera. Thanks to the depth camera, the area of obstacles can be detected in real time on the basis of the distance. In an experiment, all cameras were connected to a PC, and then a catcher's viewpoint images were generated in real time by removing the catcher and umpire (obstacles) and visualizing the pitcher pitching the ball (background) via planar projection with two color cameras. The transparency of the obstacles can be changed according to the user's preference.

Original languageEnglish
JournalKyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers
Volume66
Issue number12
DOIs
Publication statusPublished - 2012

Fingerprint

Cameras
Color
Augmented reality
Transparency
Experiments

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology
  • Computer Science Applications

Cite this

Diminished reality using real-time region extraction with depth cameras. / Shimizu, Naoki; Hashimoto, Takanori; Uematsu, Yuko; Saito, Hideo.

In: Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers, Vol. 66, No. 12, 2012.

Research output: Contribution to journalArticle

@article{91d2786352104e7e8edd2139a57ebdf4,
title = "Diminished reality using real-time region extraction with depth cameras",
abstract = "In contrast with augmented reality (AR), diminished reality (DR) is a technique for removing or concealing real objects from the real world by overlaying a background onto an area with obstacles in captured images. We propose a real time DR system that is an extension of our previous DR system used in baseball games. Our proposed system consists of three colors cameras and one depth camera. Thanks to the depth camera, the area of obstacles can be detected in real time on the basis of the distance. In an experiment, all cameras were connected to a PC, and then a catcher's viewpoint images were generated in real time by removing the catcher and umpire (obstacles) and visualizing the pitcher pitching the ball (background) via planar projection with two color cameras. The transparency of the obstacles can be changed according to the user's preference.",
author = "Naoki Shimizu and Takanori Hashimoto and Yuko Uematsu and Hideo Saito",
year = "2012",
doi = "10.3169/itej.66.J549",
language = "English",
volume = "66",
journal = "Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers",
issn = "1342-6907",
publisher = "Institute of Image Information and Television Engineers",
number = "12",

}

TY - JOUR

T1 - Diminished reality using real-time region extraction with depth cameras

AU - Shimizu, Naoki

AU - Hashimoto, Takanori

AU - Uematsu, Yuko

AU - Saito, Hideo

PY - 2012

Y1 - 2012

N2 - In contrast with augmented reality (AR), diminished reality (DR) is a technique for removing or concealing real objects from the real world by overlaying a background onto an area with obstacles in captured images. We propose a real time DR system that is an extension of our previous DR system used in baseball games. Our proposed system consists of three colors cameras and one depth camera. Thanks to the depth camera, the area of obstacles can be detected in real time on the basis of the distance. In an experiment, all cameras were connected to a PC, and then a catcher's viewpoint images were generated in real time by removing the catcher and umpire (obstacles) and visualizing the pitcher pitching the ball (background) via planar projection with two color cameras. The transparency of the obstacles can be changed according to the user's preference.

AB - In contrast with augmented reality (AR), diminished reality (DR) is a technique for removing or concealing real objects from the real world by overlaying a background onto an area with obstacles in captured images. We propose a real time DR system that is an extension of our previous DR system used in baseball games. Our proposed system consists of three colors cameras and one depth camera. Thanks to the depth camera, the area of obstacles can be detected in real time on the basis of the distance. In an experiment, all cameras were connected to a PC, and then a catcher's viewpoint images were generated in real time by removing the catcher and umpire (obstacles) and visualizing the pitcher pitching the ball (background) via planar projection with two color cameras. The transparency of the obstacles can be changed according to the user's preference.

UR - http://www.scopus.com/inward/record.url?scp=84870203693&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870203693&partnerID=8YFLogxK

U2 - 10.3169/itej.66.J549

DO - 10.3169/itej.66.J549

M3 - Article

VL - 66

JO - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers

JF - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers

SN - 1342-6907

IS - 12

ER -