TY - GEN
T1 - Vision-based detection of guitar players' fingertips without markers
AU - Kerdvibulvech, Chutisant
AU - Saito, Hideo
PY - 2007/12/1
Y1 - 2007/12/1
N2 - This paper proposes a vision-based method for detecting the positions of fingertips of a hand playing a guitar. We detect the skin color of a guitar player's hand by using on-line adaptation of color probabilities and a Bayesian classifier which can cope with considerable illumination changes and a dynamic background. The results of hand segmentation are used to train an artificial neural network. A set of Gabor filters is utilized to compute a lower-dimensional representation of the image. Then an LLM (Local-Linear- Mapping)-network is applied to map and estimate fingertip positions smoothly. The system enables us to visually detect the fingertips even when the fingertips are in front of skin-colored surfaces and/or when the fingers are not fully stretched out. Representative experimental results are also presented.
AB - This paper proposes a vision-based method for detecting the positions of fingertips of a hand playing a guitar. We detect the skin color of a guitar player's hand by using on-line adaptation of color probabilities and a Bayesian classifier which can cope with considerable illumination changes and a dynamic background. The results of hand segmentation are used to train an artificial neural network. A set of Gabor filters is utilized to compute a lower-dimensional representation of the image. Then an LLM (Local-Linear- Mapping)-network is applied to map and estimate fingertip positions smoothly. The system enables us to visually detect the fingertips even when the fingertips are in front of skin-colored surfaces and/or when the fingers are not fully stretched out. Representative experimental results are also presented.
KW - Bayesian classifier
KW - Fingertip detection of guitar player
KW - Gabor filter
KW - Local linear mapping network
UR - http://www.scopus.com/inward/record.url?scp=46449100407&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=46449100407&partnerID=8YFLogxK
U2 - 10.1109/CGIV.2007.88
DO - 10.1109/CGIV.2007.88
M3 - Conference contribution
AN - SCOPUS:46449100407
SN - 0769529283
SN - 9780769529288
T3 - Computer Graphics, Imaging and Visualisation: New Advances, CGIV 2007
SP - 419
EP - 424
BT - Computer Graphics, Imaging and Visualisation
T2 - Computer Graphics, Imaging and Visualisation: New Advances, CGIV 2007
Y2 - 13 August 2007 through 16 August 2007
ER -