Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors

Yuta Sugiura; Fumihiko Nakamura; Wataru Kawai; Takashi Kikuchi; Maki Sugimoto

doi:10.23919/SICE.2017.8105457

Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors

Yuta Sugiura, Fumihiko Nakamura, Wataru Kawai, Takashi Kikuchi, Maki Sugimoto

Department of Information and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

10 Citations (Scopus)

Abstract

We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.

Original language	English
Title of host publication	2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1082-1087
Number of pages	6
Volume	2017-November
ISBN (Electronic)	9784907764579
DOIs	https://doi.org/10.23919/SICE.2017.8105457
Publication status	Published - 2017 Nov 10
Event	56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017 - Kanazawa, Japan Duration: 2017 Sep 19 → 2017 Sep 22

Other

Other	56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017
Country	Japan
City	Kanazawa
Period	17/9/19 → 17/9/22

Keywords

Hand Gesture
Photo-Reflective Sensor
Skin Deformation

ASJC Scopus subject areas

Computer Science Applications
Control and Optimization
Control and Systems Engineering
Instrumentation

Access to Document

10.23919/SICE.2017.8105457

Fingerprint Dive into the research topics of 'Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors'. Together they form a unique fingerprint.

Cite this

Sugiura, Y., Nakamura, F., Kawai, W., Kikuchi, T., & Sugimoto, M. (2017). Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. In 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017 (Vol. 2017-November, pp. 1082-1087). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/SICE.2017.8105457

Behind the palm : Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. / Sugiura, Yuta; Nakamura, Fumihiko; Kawai, Wataru; Kikuchi, Takashi; Sugimoto, Maki.

2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. Vol. 2017-November Institute of Electrical and Electronics Engineers Inc., 2017. p. 1082-1087.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sugiura, Y, Nakamura, F, Kawai, W, Kikuchi, T & Sugimoto, M 2017, Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. in 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. vol. 2017-November, Institute of Electrical and Electronics Engineers Inc., pp. 1082-1087, 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017, Kanazawa, Japan, 17/9/19. https://doi.org/10.23919/SICE.2017.8105457

Sugiura Y, Nakamura F, Kawai W, Kikuchi T, Sugimoto M. Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. In 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. Vol. 2017-November. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1082-1087 https://doi.org/10.23919/SICE.2017.8105457

Sugiura, Yuta ; Nakamura, Fumihiko ; Kawai, Wataru ; Kikuchi, Takashi ; Sugimoto, Maki. / Behind the palm : Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. Vol. 2017-November Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1082-1087

@inproceedings{700d96ad4f734e6793e4dc15ef9f792d,

title = "Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors",

abstract = "We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.",

keywords = "Hand Gesture, Photo-Reflective Sensor, Skin Deformation",

author = "Yuta Sugiura and Fumihiko Nakamura and Wataru Kawai and Takashi Kikuchi and Maki Sugimoto",

year = "2017",

month = nov,

day = "10",

doi = "10.23919/SICE.2017.8105457",

language = "English",

volume = "2017-November",

pages = "1082--1087",

booktitle = "2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017 ; Conference date: 19-09-2017 Through 22-09-2017",

}

TY - GEN

T1 - Behind the palm

T2 - 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017

AU - Sugiura, Yuta

AU - Nakamura, Fumihiko

AU - Kawai, Wataru

AU - Kikuchi, Takashi

AU - Sugimoto, Maki

PY - 2017/11/10

Y1 - 2017/11/10

N2 - We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.

AB - We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.

KW - Hand Gesture

KW - Photo-Reflective Sensor

KW - Skin Deformation

UR - http://www.scopus.com/inward/record.url?scp=85044171732&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044171732&partnerID=8YFLogxK

U2 - 10.23919/SICE.2017.8105457

DO - 10.23919/SICE.2017.8105457

M3 - Conference contribution

AN - SCOPUS:85044171732

VL - 2017-November

SP - 1082

EP - 1087

BT - 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 19 September 2017 through 22 September 2017

ER -