Estimation of 3D Finger Postures with wearable device measuring Skin Deformation on Back of Hand

Wakaba Kuno, Yuta Sugiura, Nao Asano, Wataru Kawai, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a method for reconstructing hand posture by measuring the deformation of the back of the hand with a wearable device. Our method constructs a regression model by using the data on hand posture captured by a depth camera and data on the skin deformation of the back of the hand captured by several photo-reflective sensors attached to the wearable device. By using this regression model, the posture of the hand is reconstructed from the data of the photo-reflective sensors in real-time. The posture of fingers can be estimated without hindering the natural movement of the fingers since the deformation of the back of the hand is measured without directly measuring the position of the fingers. In our demonstration, users can reflect his/her own finger posture in a virtual environment.

Original languageEnglish
Title of host publicationVirtual Environments 2017 - ICAT - EGVE
Subtitle of host publication27th International Conference on Artificial Reality and Telexistence; 22nd Eurographics Symposium on Virtual Environments, Posters and Demos
EditorsDieter Fellner
PublisherThe Eurographics Association
Pages25-26
Number of pages2
ISBN (Electronic)9783038680529
DOIs
Publication statusPublished - 2017
Event27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017 - Adelaide, Australia
Duration: 2017 Nov 222017 Nov 24

Publication series

NameVirtual Environments 2017 - ICAT - EGVE: 27th International Conference on Artificial Reality and Telexistence; 22nd Eurographics Symposium on Virtual Environments, Posters and Demos

Conference

Conference27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017
Country/TerritoryAustralia
CityAdelaide
Period17/11/2217/11/24

ASJC Scopus subject areas

  • Computer Science Applications
  • Computational Theory and Mathematics
  • Software
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Estimation of 3D Finger Postures with wearable device measuring Skin Deformation on Back of Hand'. Together they form a unique fingerprint.

Cite this