Calibration free virtual display system using video projector onto real object surface

Shinichiro Hirooka, Hideo Saito

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

In this paper, we propose a novel virtual display system for a real object surface by using a video projector, so that the viewer can feel as if digital images are printed on the real surface with arbitrary shape. This system consists of an uncalibrated camera and video projector connected to a same PC and creates a virtual object by rendering 2D contents preserved beforehand onto a white object in a real world via a projector. For geometry registration between the rendered image and the object surface correctly, we regard the object surface as a set of a number of small rectangular regions and perform geometry registration by calculating homographies between the projector image plane and the each divided regions. By using such a homography-based method, we can avoid calibration of a camera and a projector that is necessary in a conventional method. In this system, we perform following two processes. First of all, we acquire the status of the object surface from images which capture the scene that color-coded checker patterns are projected on it and generate image rendered on it without distortion by calculating homographies. After once the projection image is generated, the rendered image can be updated if the object surface moves, or refined when it is stationary by observing the object surface. By this second process, the system always offers more accurate display. In implementation, we demonstrate our system in various conditions. This system enables it to project them as if it is printed on a real paper surface of a book. By using this system, we expect the realization of a virtual museum or other industrial application.

Original languageEnglish
Pages (from-to)88-97
Number of pages10
JournalIEICE Transactions on Communications
VolumeE89-B
Issue number1
DOIs
Publication statusPublished - 2006 Jan

Fingerprint

Display devices
Calibration
Cameras
Geometry
Museums
Industrial applications
Color

Keywords

  • Calibration free
  • Camera
  • Homography
  • Texture mapping onto arbitrary shaped surface
  • Video projector

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications
  • Information Systems
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Calibration free virtual display system using video projector onto real object surface. / Hirooka, Shinichiro; Saito, Hideo.

In: IEICE Transactions on Communications, Vol. E89-B, No. 1, 01.2006, p. 88-97.

Research output: Contribution to journalArticle

@article{8968234cbd37401ebd5aa20cced8b094,
title = "Calibration free virtual display system using video projector onto real object surface",
abstract = "In this paper, we propose a novel virtual display system for a real object surface by using a video projector, so that the viewer can feel as if digital images are printed on the real surface with arbitrary shape. This system consists of an uncalibrated camera and video projector connected to a same PC and creates a virtual object by rendering 2D contents preserved beforehand onto a white object in a real world via a projector. For geometry registration between the rendered image and the object surface correctly, we regard the object surface as a set of a number of small rectangular regions and perform geometry registration by calculating homographies between the projector image plane and the each divided regions. By using such a homography-based method, we can avoid calibration of a camera and a projector that is necessary in a conventional method. In this system, we perform following two processes. First of all, we acquire the status of the object surface from images which capture the scene that color-coded checker patterns are projected on it and generate image rendered on it without distortion by calculating homographies. After once the projection image is generated, the rendered image can be updated if the object surface moves, or refined when it is stationary by observing the object surface. By this second process, the system always offers more accurate display. In implementation, we demonstrate our system in various conditions. This system enables it to project them as if it is printed on a real paper surface of a book. By using this system, we expect the realization of a virtual museum or other industrial application.",
keywords = "Calibration free, Camera, Homography, Texture mapping onto arbitrary shaped surface, Video projector",
author = "Shinichiro Hirooka and Hideo Saito",
year = "2006",
month = "1",
doi = "10.1093/ietisy/e89-d.1.88",
language = "English",
volume = "E89-B",
pages = "88--97",
journal = "IEICE Transactions on Communications",
issn = "0916-8516",
publisher = "Maruzen Co., Ltd/Maruzen Kabushikikaisha",
number = "1",

}

TY - JOUR

T1 - Calibration free virtual display system using video projector onto real object surface

AU - Hirooka, Shinichiro

AU - Saito, Hideo

PY - 2006/1

Y1 - 2006/1

N2 - In this paper, we propose a novel virtual display system for a real object surface by using a video projector, so that the viewer can feel as if digital images are printed on the real surface with arbitrary shape. This system consists of an uncalibrated camera and video projector connected to a same PC and creates a virtual object by rendering 2D contents preserved beforehand onto a white object in a real world via a projector. For geometry registration between the rendered image and the object surface correctly, we regard the object surface as a set of a number of small rectangular regions and perform geometry registration by calculating homographies between the projector image plane and the each divided regions. By using such a homography-based method, we can avoid calibration of a camera and a projector that is necessary in a conventional method. In this system, we perform following two processes. First of all, we acquire the status of the object surface from images which capture the scene that color-coded checker patterns are projected on it and generate image rendered on it without distortion by calculating homographies. After once the projection image is generated, the rendered image can be updated if the object surface moves, or refined when it is stationary by observing the object surface. By this second process, the system always offers more accurate display. In implementation, we demonstrate our system in various conditions. This system enables it to project them as if it is printed on a real paper surface of a book. By using this system, we expect the realization of a virtual museum or other industrial application.

AB - In this paper, we propose a novel virtual display system for a real object surface by using a video projector, so that the viewer can feel as if digital images are printed on the real surface with arbitrary shape. This system consists of an uncalibrated camera and video projector connected to a same PC and creates a virtual object by rendering 2D contents preserved beforehand onto a white object in a real world via a projector. For geometry registration between the rendered image and the object surface correctly, we regard the object surface as a set of a number of small rectangular regions and perform geometry registration by calculating homographies between the projector image plane and the each divided regions. By using such a homography-based method, we can avoid calibration of a camera and a projector that is necessary in a conventional method. In this system, we perform following two processes. First of all, we acquire the status of the object surface from images which capture the scene that color-coded checker patterns are projected on it and generate image rendered on it without distortion by calculating homographies. After once the projection image is generated, the rendered image can be updated if the object surface moves, or refined when it is stationary by observing the object surface. By this second process, the system always offers more accurate display. In implementation, we demonstrate our system in various conditions. This system enables it to project them as if it is printed on a real paper surface of a book. By using this system, we expect the realization of a virtual museum or other industrial application.

KW - Calibration free

KW - Camera

KW - Homography

KW - Texture mapping onto arbitrary shaped surface

KW - Video projector

UR - http://www.scopus.com/inward/record.url?scp=32244436434&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=32244436434&partnerID=8YFLogxK

U2 - 10.1093/ietisy/e89-d.1.88

DO - 10.1093/ietisy/e89-d.1.88

M3 - Article

AN - SCOPUS:32244436434

VL - E89-B

SP - 88

EP - 97

JO - IEICE Transactions on Communications

JF - IEICE Transactions on Communications

SN - 0916-8516

IS - 1

ER -