Complemental use of multiple cameras for stable tracking of multiple markers

Yuki Arai, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages413-420
Number of pages8
Volume5622 LNCS
DOIs
Publication statusPublished - 2009
Event3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009 - San Diego, CA, United States
Duration: 2009 Jul 192009 Jul 24

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5622 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009
CountryUnited States
CitySan Diego, CA
Period09/7/1909/7/24

Fingerprint

Projection Matrix
Camera
Cameras
Augmented reality
Augmented Reality
Particle Filter
Computing
Estimate

Keywords

  • Augmented reality
  • Marker tracking
  • Multiple cameras
  • Particle filter

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Arai, Y., & Saito, H. (2009). Complemental use of multiple cameras for stable tracking of multiple markers. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5622 LNCS, pp. 413-420). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5622 LNCS). https://doi.org/10.1007/978-3-642-02771-0_46

Complemental use of multiple cameras for stable tracking of multiple markers. / Arai, Yuki; Saito, Hideo.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5622 LNCS 2009. p. 413-420 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5622 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Arai, Y & Saito, H 2009, Complemental use of multiple cameras for stable tracking of multiple markers. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 5622 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5622 LNCS, pp. 413-420, 3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009, San Diego, CA, United States, 09/7/19. https://doi.org/10.1007/978-3-642-02771-0_46
Arai Y, Saito H. Complemental use of multiple cameras for stable tracking of multiple markers. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5622 LNCS. 2009. p. 413-420. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-02771-0_46
Arai, Yuki ; Saito, Hideo. / Complemental use of multiple cameras for stable tracking of multiple markers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5622 LNCS 2009. pp. 413-420 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{1f7a56d672be42f084b5268f2c5580d5,
title = "Complemental use of multiple cameras for stable tracking of multiple markers",
abstract = "In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.",
keywords = "Augmented reality, Marker tracking, Multiple cameras, Particle filter",
author = "Yuki Arai and Hideo Saito",
year = "2009",
doi = "10.1007/978-3-642-02771-0_46",
language = "English",
isbn = "3642027709",
volume = "5622 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "413--420",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Complemental use of multiple cameras for stable tracking of multiple markers

AU - Arai, Yuki

AU - Saito, Hideo

PY - 2009

Y1 - 2009

N2 - In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.

AB - In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.

KW - Augmented reality

KW - Marker tracking

KW - Multiple cameras

KW - Particle filter

UR - http://www.scopus.com/inward/record.url?scp=76649083246&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=76649083246&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-02771-0_46

DO - 10.1007/978-3-642-02771-0_46

M3 - Conference contribution

AN - SCOPUS:76649083246

SN - 3642027709

SN - 9783642027703

VL - 5622 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 413

EP - 420

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -