Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters

Chutisant Kerdvibulvech, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

This paper presents a vision-based method for tracking guitar fingerings played by guitar players from stereo cameras. We propose a novel framework for colored finger markers tracking by integrating a Bayesian classifier into particle filters, with the advantages of performing automatic track initialization and recovering from tracking failures in a dynamic background. ARTag (Augmented Reality Tag) is utilized to calculate the projection matrix as an online process which allow guitar to be moved while playing. By using online adaptation of color probabilities, it is also able to cope with illumination changes.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages625-638
Number of pages14
Volume4872 LNCS
Publication statusPublished - 2007
Event2nd IEEE Pacific Rim Symposium on Video and Image Technology, PSIVT 2007 - Santiago, Chile
Duration: 2007 Dec 172007 Dec 19

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4872 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other2nd IEEE Pacific Rim Symposium on Video and Image Technology, PSIVT 2007
CountryChile
CitySantiago
Period07/12/1707/12/19

Fingerprint

Bayesian Classifier
Augmented reality
Particle Filter
Lighting
Fingers
Classifiers
Color
Cameras
Projection Matrix
Augmented Reality
Initialization
Illumination
Camera
Calculate
Vision

Keywords

  • Augmented reality tag
  • Bayesian classifier
  • Guitarist fingering tracking
  • Particle filters

ASJC Scopus subject areas

  • Computer Science(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Theoretical Computer Science

Cite this

Kerdvibulvech, C., & Saito, H. (2007). Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4872 LNCS, pp. 625-638). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4872 LNCS).

Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. / Kerdvibulvech, Chutisant; Saito, Hideo.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4872 LNCS 2007. p. 625-638 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4872 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kerdvibulvech, C & Saito, H 2007, Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 4872 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4872 LNCS, pp. 625-638, 2nd IEEE Pacific Rim Symposium on Video and Image Technology, PSIVT 2007, Santiago, Chile, 07/12/17.
Kerdvibulvech C, Saito H. Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4872 LNCS. 2007. p. 625-638. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Kerdvibulvech, Chutisant ; Saito, Hideo. / Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4872 LNCS 2007. pp. 625-638 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{2bb11811dfa245f181d3b0f36a9bf556,
title = "Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters",
abstract = "This paper presents a vision-based method for tracking guitar fingerings played by guitar players from stereo cameras. We propose a novel framework for colored finger markers tracking by integrating a Bayesian classifier into particle filters, with the advantages of performing automatic track initialization and recovering from tracking failures in a dynamic background. ARTag (Augmented Reality Tag) is utilized to calculate the projection matrix as an online process which allow guitar to be moved while playing. By using online adaptation of color probabilities, it is also able to cope with illumination changes.",
keywords = "Augmented reality tag, Bayesian classifier, Guitarist fingering tracking, Particle filters",
author = "Chutisant Kerdvibulvech and Hideo Saito",
year = "2007",
language = "English",
isbn = "9783540771289",
volume = "4872 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "625--638",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters

AU - Kerdvibulvech, Chutisant

AU - Saito, Hideo

PY - 2007

Y1 - 2007

N2 - This paper presents a vision-based method for tracking guitar fingerings played by guitar players from stereo cameras. We propose a novel framework for colored finger markers tracking by integrating a Bayesian classifier into particle filters, with the advantages of performing automatic track initialization and recovering from tracking failures in a dynamic background. ARTag (Augmented Reality Tag) is utilized to calculate the projection matrix as an online process which allow guitar to be moved while playing. By using online adaptation of color probabilities, it is also able to cope with illumination changes.

AB - This paper presents a vision-based method for tracking guitar fingerings played by guitar players from stereo cameras. We propose a novel framework for colored finger markers tracking by integrating a Bayesian classifier into particle filters, with the advantages of performing automatic track initialization and recovering from tracking failures in a dynamic background. ARTag (Augmented Reality Tag) is utilized to calculate the projection matrix as an online process which allow guitar to be moved while playing. By using online adaptation of color probabilities, it is also able to cope with illumination changes.

KW - Augmented reality tag

KW - Bayesian classifier

KW - Guitarist fingering tracking

KW - Particle filters

UR - http://www.scopus.com/inward/record.url?scp=38149118715&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38149118715&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9783540771289

VL - 4872 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 625

EP - 638

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -