Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors

Yuta Sugiura, Fumihiko Nakamura, Wataru Kawai, Takashi Kikuchi, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.

Original languageEnglish
Title of host publication2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1082-1087
Number of pages6
Volume2017-November
ISBN (Electronic)9784907764579
DOIs
Publication statusPublished - 2017 Nov 10
Event56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017 - Kanazawa, Japan
Duration: 2017 Sep 192017 Sep 22

Other

Other56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017
CountryJapan
CityKanazawa
Period17/9/1917/9/22

Fingerprint

Hand Gesture Recognition
Gesture recognition
Optical Sensor
Optical sensors
optical measuring instruments
Skin
Gesture
Sensor
sensors
Sensors
Gesture Recognition
registers
muscles
Bone
Muscle
learning
bones
Support vector machines
Support Vector Machine
Motion

Keywords

  • Hand Gesture
  • Photo-Reflective Sensor
  • Skin Deformation

ASJC Scopus subject areas

  • Computer Science Applications
  • Control and Optimization
  • Control and Systems Engineering
  • Instrumentation

Cite this

Sugiura, Y., Nakamura, F., Kawai, W., Kikuchi, T., & Sugimoto, M. (2017). Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. In 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017 (Vol. 2017-November, pp. 1082-1087). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/SICE.2017.8105457

Behind the palm : Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. / Sugiura, Yuta; Nakamura, Fumihiko; Kawai, Wataru; Kikuchi, Takashi; Sugimoto, Maki.

2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. Vol. 2017-November Institute of Electrical and Electronics Engineers Inc., 2017. p. 1082-1087.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sugiura, Y, Nakamura, F, Kawai, W, Kikuchi, T & Sugimoto, M 2017, Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. in 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. vol. 2017-November, Institute of Electrical and Electronics Engineers Inc., pp. 1082-1087, 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017, Kanazawa, Japan, 17/9/19. https://doi.org/10.23919/SICE.2017.8105457
Sugiura Y, Nakamura F, Kawai W, Kikuchi T, Sugimoto M. Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. In 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. Vol. 2017-November. Institute of Electrical and Electronics Engineers Inc. 2017. p. 1082-1087 https://doi.org/10.23919/SICE.2017.8105457
Sugiura, Yuta ; Nakamura, Fumihiko ; Kawai, Wataru ; Kikuchi, Takashi ; Sugimoto, Maki. / Behind the palm : Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017. Vol. 2017-November Institute of Electrical and Electronics Engineers Inc., 2017. pp. 1082-1087
@inproceedings{700d96ad4f734e6793e4dc15ef9f792d,
title = "Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors",
abstract = "We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.",
keywords = "Hand Gesture, Photo-Reflective Sensor, Skin Deformation",
author = "Yuta Sugiura and Fumihiko Nakamura and Wataru Kawai and Takashi Kikuchi and Maki Sugimoto",
year = "2017",
month = "11",
day = "10",
doi = "10.23919/SICE.2017.8105457",
language = "English",
volume = "2017-November",
pages = "1082--1087",
booktitle = "2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Behind the palm

T2 - Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors

AU - Sugiura, Yuta

AU - Nakamura, Fumihiko

AU - Kawai, Wataru

AU - Kikuchi, Takashi

AU - Sugimoto, Maki

PY - 2017/11/10

Y1 - 2017/11/10

N2 - We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.

AB - We propose a system consisting of a wearable device equipped with photo-reflective sensors arranged in an array. Hand gestures are recognized by measuring the skin deformation of the back of the hand. Since the muscles and bones on the back of the hand are linked to the fingers, finger movement can be clearly observed. Skin deformation is measured using several photo-reflective sensors. Skin deformation can be determined by measuring the distance between the device and skin with these sensors. The system estimates hand gestures with a support vector machine using the sensor data. Since this system simultaneously records the hand shape using Leap Motion in the learning phase, a user can freely register gestures. The system further displays a reconstructed digital hand as a gesture-recognition result.

KW - Hand Gesture

KW - Photo-Reflective Sensor

KW - Skin Deformation

UR - http://www.scopus.com/inward/record.url?scp=85044171732&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044171732&partnerID=8YFLogxK

U2 - 10.23919/SICE.2017.8105457

DO - 10.23919/SICE.2017.8105457

M3 - Conference contribution

AN - SCOPUS:85044171732

VL - 2017-November

SP - 1082

EP - 1087

BT - 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -