Virtual object overlay onto uncalibrated camera images for augmented reality

Shunsuke Harasaki, Hideo Saito

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

We propose a new registration algorithm for overlaying a virtual object generated in a graphics system onto a real-world image sequence captured by an uncalibrated camera for augmented reality. In our method, a Projective Grid Space (PGS) is defined by using two base images captured from different positions with uncalibrated cameras. In the PGS, correct perspective views of a virtual object can be registered onto an image sequence captured by an uncalibrated camera in real time. Since our method is based on the projective geometry that is defined by two base images, the registration does not require any markers with known 3D positions, but several (at least eight) image feature points are needed for estimating fundamental matrices of the augmented camera with the base images. Based on this method, we constructed an augmented reality system for an uncalibrated camera without any 3D position information in the real world, which runs nearly at video rate (11 frames per second). Experimental results demonstrate the advantages of this method.

Original languageEnglish
Pages (from-to)47-55
Number of pages9
JournalSystems and Computers in Japan
Volume34
Issue number5
DOIs
Publication statusPublished - 2003 May

Fingerprint

Augmented reality
Augmented Reality
Overlay
Camera
Cameras
Image Sequence
Registration
Grid
Fundamental Matrix
Projective geometry
Feature Point
Object
Geometry
Experimental Results
Demonstrate

Keywords

  • Augmented reality
  • Image base
  • Projective geometry, complex reality
  • Uncalibrated camera

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Hardware and Architecture
  • Information Systems
  • Theoretical Computer Science

Cite this

Virtual object overlay onto uncalibrated camera images for augmented reality. / Harasaki, Shunsuke; Saito, Hideo.

In: Systems and Computers in Japan, Vol. 34, No. 5, 05.2003, p. 47-55.

Research output: Contribution to journalArticle

@article{f5de1d86948543e2ad50cf2fc5a903f1,
title = "Virtual object overlay onto uncalibrated camera images for augmented reality",
abstract = "We propose a new registration algorithm for overlaying a virtual object generated in a graphics system onto a real-world image sequence captured by an uncalibrated camera for augmented reality. In our method, a Projective Grid Space (PGS) is defined by using two base images captured from different positions with uncalibrated cameras. In the PGS, correct perspective views of a virtual object can be registered onto an image sequence captured by an uncalibrated camera in real time. Since our method is based on the projective geometry that is defined by two base images, the registration does not require any markers with known 3D positions, but several (at least eight) image feature points are needed for estimating fundamental matrices of the augmented camera with the base images. Based on this method, we constructed an augmented reality system for an uncalibrated camera without any 3D position information in the real world, which runs nearly at video rate (11 frames per second). Experimental results demonstrate the advantages of this method.",
keywords = "Augmented reality, Image base, Projective geometry, complex reality, Uncalibrated camera",
author = "Shunsuke Harasaki and Hideo Saito",
year = "2003",
month = "5",
doi = "10.1002/scj.10261",
language = "English",
volume = "34",
pages = "47--55",
journal = "Systems and Computers in Japan",
issn = "0882-1666",
publisher = "John Wiley and Sons Inc.",
number = "5",

}

TY - JOUR

T1 - Virtual object overlay onto uncalibrated camera images for augmented reality

AU - Harasaki, Shunsuke

AU - Saito, Hideo

PY - 2003/5

Y1 - 2003/5

N2 - We propose a new registration algorithm for overlaying a virtual object generated in a graphics system onto a real-world image sequence captured by an uncalibrated camera for augmented reality. In our method, a Projective Grid Space (PGS) is defined by using two base images captured from different positions with uncalibrated cameras. In the PGS, correct perspective views of a virtual object can be registered onto an image sequence captured by an uncalibrated camera in real time. Since our method is based on the projective geometry that is defined by two base images, the registration does not require any markers with known 3D positions, but several (at least eight) image feature points are needed for estimating fundamental matrices of the augmented camera with the base images. Based on this method, we constructed an augmented reality system for an uncalibrated camera without any 3D position information in the real world, which runs nearly at video rate (11 frames per second). Experimental results demonstrate the advantages of this method.

AB - We propose a new registration algorithm for overlaying a virtual object generated in a graphics system onto a real-world image sequence captured by an uncalibrated camera for augmented reality. In our method, a Projective Grid Space (PGS) is defined by using two base images captured from different positions with uncalibrated cameras. In the PGS, correct perspective views of a virtual object can be registered onto an image sequence captured by an uncalibrated camera in real time. Since our method is based on the projective geometry that is defined by two base images, the registration does not require any markers with known 3D positions, but several (at least eight) image feature points are needed for estimating fundamental matrices of the augmented camera with the base images. Based on this method, we constructed an augmented reality system for an uncalibrated camera without any 3D position information in the real world, which runs nearly at video rate (11 frames per second). Experimental results demonstrate the advantages of this method.

KW - Augmented reality

KW - Image base

KW - Projective geometry, complex reality

KW - Uncalibrated camera

UR - http://www.scopus.com/inward/record.url?scp=0037401493&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0037401493&partnerID=8YFLogxK

U2 - 10.1002/scj.10261

DO - 10.1002/scj.10261

M3 - Article

AN - SCOPUS:0037401493

VL - 34

SP - 47

EP - 55

JO - Systems and Computers in Japan

JF - Systems and Computers in Japan

SN - 0882-1666

IS - 5

ER -