Colour descriptors for tracking in spatial augmented reality

Thijs Kooi, Francois De Sorbier, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Augmented Reality is an emerging research field, that aims for the composition of real and virtual imagery, by means of a camera and display device. Spatial augmented reality employs data projectors to augment the real world. In this setting, traditional tracking methods fall short due to the interference caused by the projector. Recent works assume a calibration process to model the projector and assume continuity in movement of the object being tracked. In this paper we present a tracking-by-detection system that does not require such a procedure and makes use of natural features represented by SIFT descriptors. We evaluate a set of photometric invariants that have previously been shown to improve the performance of object recognition, added to the descriptor to reduce the influence of the projector. We evaluate the descriptors based on precision-recall under projector distortion and the total system based on its tracking performance. Results show tracking is significantly more precise using one of the invariants.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages387-399
Number of pages13
Volume7729 LNCS
EditionPART 2
DOIs
Publication statusPublished - 2013
Event11th Asian Conference on Computer Vision, ACCV 2012 - Daejeon, Korea, Republic of
Duration: 2012 Nov 52012 Nov 6

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume7729 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other11th Asian Conference on Computer Vision, ACCV 2012
CountryKorea, Republic of
CityDaejeon
Period12/11/512/11/6

Fingerprint

Augmented reality
Augmented Reality
Projector
Descriptors
Color
Object recognition
Cameras
Display devices
Calibration
Chemical analysis
Invariant
Scale Invariant Feature Transform
Evaluate
Object Recognition
Display
Interference
Camera

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Kooi, T., De Sorbier, F., & Saito, H. (2013). Colour descriptors for tracking in spatial augmented reality. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (PART 2 ed., Vol. 7729 LNCS, pp. 387-399). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7729 LNCS, No. PART 2). https://doi.org/10.1007/978-3-642-37484-5_32

Colour descriptors for tracking in spatial augmented reality. / Kooi, Thijs; De Sorbier, Francois; Saito, Hideo.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7729 LNCS PART 2. ed. 2013. p. 387-399 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7729 LNCS, No. PART 2).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kooi, T, De Sorbier, F & Saito, H 2013, Colour descriptors for tracking in spatial augmented reality. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 edn, vol. 7729 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 7729 LNCS, pp. 387-399, 11th Asian Conference on Computer Vision, ACCV 2012, Daejeon, Korea, Republic of, 12/11/5. https://doi.org/10.1007/978-3-642-37484-5_32
Kooi T, De Sorbier F, Saito H. Colour descriptors for tracking in spatial augmented reality. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). PART 2 ed. Vol. 7729 LNCS. 2013. p. 387-399. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). https://doi.org/10.1007/978-3-642-37484-5_32
Kooi, Thijs ; De Sorbier, Francois ; Saito, Hideo. / Colour descriptors for tracking in spatial augmented reality. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7729 LNCS PART 2. ed. 2013. pp. 387-399 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).
@inproceedings{ecd93861e1634ba6ae1b560e9e95ef90,
title = "Colour descriptors for tracking in spatial augmented reality",
abstract = "Augmented Reality is an emerging research field, that aims for the composition of real and virtual imagery, by means of a camera and display device. Spatial augmented reality employs data projectors to augment the real world. In this setting, traditional tracking methods fall short due to the interference caused by the projector. Recent works assume a calibration process to model the projector and assume continuity in movement of the object being tracked. In this paper we present a tracking-by-detection system that does not require such a procedure and makes use of natural features represented by SIFT descriptors. We evaluate a set of photometric invariants that have previously been shown to improve the performance of object recognition, added to the descriptor to reduce the influence of the projector. We evaluate the descriptors based on precision-recall under projector distortion and the total system based on its tracking performance. Results show tracking is significantly more precise using one of the invariants.",
author = "Thijs Kooi and {De Sorbier}, Francois and Hideo Saito",
year = "2013",
doi = "10.1007/978-3-642-37484-5_32",
language = "English",
isbn = "9783642374838",
volume = "7729 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 2",
pages = "387--399",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
edition = "PART 2",

}

TY - GEN

T1 - Colour descriptors for tracking in spatial augmented reality

AU - Kooi, Thijs

AU - De Sorbier, Francois

AU - Saito, Hideo

PY - 2013

Y1 - 2013

N2 - Augmented Reality is an emerging research field, that aims for the composition of real and virtual imagery, by means of a camera and display device. Spatial augmented reality employs data projectors to augment the real world. In this setting, traditional tracking methods fall short due to the interference caused by the projector. Recent works assume a calibration process to model the projector and assume continuity in movement of the object being tracked. In this paper we present a tracking-by-detection system that does not require such a procedure and makes use of natural features represented by SIFT descriptors. We evaluate a set of photometric invariants that have previously been shown to improve the performance of object recognition, added to the descriptor to reduce the influence of the projector. We evaluate the descriptors based on precision-recall under projector distortion and the total system based on its tracking performance. Results show tracking is significantly more precise using one of the invariants.

AB - Augmented Reality is an emerging research field, that aims for the composition of real and virtual imagery, by means of a camera and display device. Spatial augmented reality employs data projectors to augment the real world. In this setting, traditional tracking methods fall short due to the interference caused by the projector. Recent works assume a calibration process to model the projector and assume continuity in movement of the object being tracked. In this paper we present a tracking-by-detection system that does not require such a procedure and makes use of natural features represented by SIFT descriptors. We evaluate a set of photometric invariants that have previously been shown to improve the performance of object recognition, added to the descriptor to reduce the influence of the projector. We evaluate the descriptors based on precision-recall under projector distortion and the total system based on its tracking performance. Results show tracking is significantly more precise using one of the invariants.

UR - http://www.scopus.com/inward/record.url?scp=84876007399&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876007399&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-37484-5_32

DO - 10.1007/978-3-642-37484-5_32

M3 - Conference contribution

AN - SCOPUS:84876007399

SN - 9783642374838

VL - 7729 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 387

EP - 399

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -