Multiple planes based registration using 3D Projective Space for Augmented Reality

Yuko Uematsu, Hideo Saito

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

We propose a vision-based registration method for Augmented Reality (AR) that uses real scenes containing multiple planar structures. Our method provides users with an enhanced view of a real scene by overlaying computer-generated virtual objects onto images captured with a movable camera. The virtual objects are associated with a 3D planar structure and appeared to move with that structure. To align the coordinates of the virtual objects with the coordinates of the images captured with the camera, the camera's motion should be estimated for every frame by tracking and integrating the multiple planes. In contrast with related work, the proposed method does not require a priori knowledge about the geometrical relationships among the multiple planes because the geometrical relationship is automatically estimated by "Projective Space". This space is 3D and is defined by projective reconstruction of two reference images. Automatic estimation using the Projective Space can eliminate the time-consuming task of measuring the planes and the constraints of plane arrangement, e.g. only vertical or co-planar. Therefore, the proposed method can be applied even to complicated multi-planar scenes.

Original languageEnglish
Pages (from-to)1484-1496
Number of pages13
JournalImage and Vision Computing
Volume27
Issue number10
DOIs
Publication statusPublished - 2009 Sep 2

Fingerprint

Augmented reality
Cameras

Keywords

  • Augmented Reality
  • Mixed Reality
  • Multiple planes
  • Projective Space
  • Vision-based registration

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

Multiple planes based registration using 3D Projective Space for Augmented Reality. / Uematsu, Yuko; Saito, Hideo.

In: Image and Vision Computing, Vol. 27, No. 10, 02.09.2009, p. 1484-1496.

Research output: Contribution to journalArticle

@article{7fbc1c7af1c044778306deb89e5bc19b,
title = "Multiple planes based registration using 3D Projective Space for Augmented Reality",
abstract = "We propose a vision-based registration method for Augmented Reality (AR) that uses real scenes containing multiple planar structures. Our method provides users with an enhanced view of a real scene by overlaying computer-generated virtual objects onto images captured with a movable camera. The virtual objects are associated with a 3D planar structure and appeared to move with that structure. To align the coordinates of the virtual objects with the coordinates of the images captured with the camera, the camera's motion should be estimated for every frame by tracking and integrating the multiple planes. In contrast with related work, the proposed method does not require a priori knowledge about the geometrical relationships among the multiple planes because the geometrical relationship is automatically estimated by {"}Projective Space{"}. This space is 3D and is defined by projective reconstruction of two reference images. Automatic estimation using the Projective Space can eliminate the time-consuming task of measuring the planes and the constraints of plane arrangement, e.g. only vertical or co-planar. Therefore, the proposed method can be applied even to complicated multi-planar scenes.",
keywords = "Augmented Reality, Mixed Reality, Multiple planes, Projective Space, Vision-based registration",
author = "Yuko Uematsu and Hideo Saito",
year = "2009",
month = "9",
day = "2",
doi = "10.1016/j.imavis.2009.01.003",
language = "English",
volume = "27",
pages = "1484--1496",
journal = "Image and Vision Computing",
issn = "0262-8856",
publisher = "Elsevier Limited",
number = "10",

}

TY - JOUR

T1 - Multiple planes based registration using 3D Projective Space for Augmented Reality

AU - Uematsu, Yuko

AU - Saito, Hideo

PY - 2009/9/2

Y1 - 2009/9/2

N2 - We propose a vision-based registration method for Augmented Reality (AR) that uses real scenes containing multiple planar structures. Our method provides users with an enhanced view of a real scene by overlaying computer-generated virtual objects onto images captured with a movable camera. The virtual objects are associated with a 3D planar structure and appeared to move with that structure. To align the coordinates of the virtual objects with the coordinates of the images captured with the camera, the camera's motion should be estimated for every frame by tracking and integrating the multiple planes. In contrast with related work, the proposed method does not require a priori knowledge about the geometrical relationships among the multiple planes because the geometrical relationship is automatically estimated by "Projective Space". This space is 3D and is defined by projective reconstruction of two reference images. Automatic estimation using the Projective Space can eliminate the time-consuming task of measuring the planes and the constraints of plane arrangement, e.g. only vertical or co-planar. Therefore, the proposed method can be applied even to complicated multi-planar scenes.

AB - We propose a vision-based registration method for Augmented Reality (AR) that uses real scenes containing multiple planar structures. Our method provides users with an enhanced view of a real scene by overlaying computer-generated virtual objects onto images captured with a movable camera. The virtual objects are associated with a 3D planar structure and appeared to move with that structure. To align the coordinates of the virtual objects with the coordinates of the images captured with the camera, the camera's motion should be estimated for every frame by tracking and integrating the multiple planes. In contrast with related work, the proposed method does not require a priori knowledge about the geometrical relationships among the multiple planes because the geometrical relationship is automatically estimated by "Projective Space". This space is 3D and is defined by projective reconstruction of two reference images. Automatic estimation using the Projective Space can eliminate the time-consuming task of measuring the planes and the constraints of plane arrangement, e.g. only vertical or co-planar. Therefore, the proposed method can be applied even to complicated multi-planar scenes.

KW - Augmented Reality

KW - Mixed Reality

KW - Multiple planes

KW - Projective Space

KW - Vision-based registration

UR - http://www.scopus.com/inward/record.url?scp=67349275339&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67349275339&partnerID=8YFLogxK

U2 - 10.1016/j.imavis.2009.01.003

DO - 10.1016/j.imavis.2009.01.003

M3 - Article

VL - 27

SP - 1484

EP - 1496

JO - Image and Vision Computing

JF - Image and Vision Computing

SN - 0262-8856

IS - 10

ER -