Complemental use of multiple cameras for stable tracking of multiple markers

Yuki Arai; Hideo Saito

doi:10.1007/978-3-642-02771-0_46

Complemental use of multiple cameras for stable tracking of multiple markers

Yuki Arai, Hideo Saito

Department of Information and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.

Original language	English
Title of host publication	Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings
Pages	413-420
Number of pages	8
DOIs	https://doi.org/10.1007/978-3-642-02771-0_46
Publication status	Published - 2009
Event	3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009 - San Diego, CA, United States Duration: 2009 Jul 19 → 2009 Jul 24

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	5622 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009
Country/Territory	United States
City	San Diego, CA
Period	09/7/19 → 09/7/24

Keywords

Augmented reality
Marker tracking
Multiple cameras
Particle filter

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-642-02771-0_46

Cite this

Arai, Y., & Saito, H. (2009). Complemental use of multiple cameras for stable tracking of multiple markers. In Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings (pp. 413-420). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5622 LNCS). https://doi.org/10.1007/978-3-642-02771-0_46

Complemental use of multiple cameras for stable tracking of multiple markers. / Arai, Yuki; Saito, Hideo.
Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings. 2009. p. 413-420 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5622 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Arai, Y & Saito, H 2009, Complemental use of multiple cameras for stable tracking of multiple markers. in Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5622 LNCS, pp. 413-420, 3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009, San Diego, CA, United States, 09/7/19. https://doi.org/10.1007/978-3-642-02771-0_46

Arai Y, Saito H. Complemental use of multiple cameras for stable tracking of multiple markers. In Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings. 2009. p. 413-420. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-02771-0_46

Arai, Yuki ; Saito, Hideo. / Complemental use of multiple cameras for stable tracking of multiple markers. Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings. 2009. pp. 413-420 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{1f7a56d672be42f084b5268f2c5580d5,

title = "Complemental use of multiple cameras for stable tracking of multiple markers",

abstract = "In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.",

keywords = "Augmented reality, Marker tracking, Multiple cameras, Particle filter",

author = "Yuki Arai and Hideo Saito",

year = "2009",

doi = "10.1007/978-3-642-02771-0_46",

language = "English",

isbn = "3642027709",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "413--420",

booktitle = "Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings",

note = "3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009 ; Conference date: 19-07-2009 Through 24-07-2009",

}

TY - GEN

T1 - Complemental use of multiple cameras for stable tracking of multiple markers

AU - Arai, Yuki

AU - Saito, Hideo

PY - 2009

Y1 - 2009

N2 - In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.

AB - In many applications of Augmented Reality (AR), rectangular markers are tracked in real time by capturing with cameras. In this paper, we consider the AR application in which virtual objects are displayed onto markers while the markers and the cameras are freely moving. In this situation, the marker cannot be tracked when the marker is occluded by some objects. In this paper, we propose a method for tracking the projection matrix between the image and the marker even when the maker is occluded, by using cameras. In this method, we transfer the projection matrix for the marker that is detected by the cameras in order to estimate the relative projection matrix for the occluded marker. After computing the relative projection matrices using multiple cameras, we compute a more accurate projection matrix by using particle filter. As a result, we can continuously track the markers even when the marker is occluded.

KW - Augmented reality

KW - Marker tracking

KW - Multiple cameras

KW - Particle filter

UR - http://www.scopus.com/inward/record.url?scp=76649083246&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=76649083246&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-02771-0_46

DO - 10.1007/978-3-642-02771-0_46

M3 - Conference contribution

AN - SCOPUS:76649083246

SN - 3642027709

SN - 9783642027703

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 413

EP - 420

BT - Virtual and Mixed Reality - Third International Conference, VMR 2009, Held as Part of HCI International 2009, Proceedings

T2 - 3rd International Conference on Virtual and Mixed Reality, VMR 2009. Held as Part of HCI International 2009

Y2 - 19 July 2009 through 24 July 2009

ER -

Complemental use of multiple cameras for stable tracking of multiple markers

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this