3D reconstruction of hand postures by measuring skin deformation on back hand

Wakaba Kuno, Yuta Sugiura, Nao Asano, Wataru Kawai, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this research, we propose a method for reconstructing hand posture by measuring the deformation of the back of the hand with a wearable device. The deformation of skin on the back of the hand can be measured by using several photo-reflective sensors attached to a wearable device. In the learning phase, our method constructs a regression model by using the data on hand posture captured by a depth camera and data on the skin deformation of the back of the hand captured by several photoreflective sensors. In the estimation phase, by using this regression model, the posture of the hand is reconstructed from the data of the photo-reflective sensors in real-time. The posture of fingers can be estimated without hindering the natural movement of the fingers since the deformation of the back of the hand is measured without directly measuring the position of the fingers. This method can be used by users to manipulate information in a virtual environment with their fingers. We conducted an experiment to evaluate the accuracy of reconstructing hand posture with the proposed system.

Original languageEnglish
Title of host publicationInternational Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017
EditorsRobert W. Lindeman, Gerd Bruder, Daisuke Iwai
PublisherEurographics Association
Pages221-228
Number of pages8
ISBN (Electronic)9783038680383
DOIs
Publication statusPublished - 2017
Event27th International Conference on Artificial Reality and Telexistence, ICAT 2017 and the 22nd Eurographics Symposium on Virtual Environments, EGVE 2017 - Adelaide, Australia
Duration: 2017 Nov 222017 Nov 24

Publication series

NameInternational Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017

Conference

Conference27th International Conference on Artificial Reality and Telexistence, ICAT 2017 and the 22nd Eurographics Symposium on Virtual Environments, EGVE 2017
CountryAustralia
CityAdelaide
Period17/11/2217/11/24

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction

Fingerprint Dive into the research topics of '3D reconstruction of hand postures by measuring skin deformation on back hand'. Together they form a unique fingerprint.

  • Cite this

    Kuno, W., Sugiura, Y., Asano, N., Kawai, W., & Sugimoto, M. (2017). 3D reconstruction of hand postures by measuring skin deformation on back hand. In R. W. Lindeman, G. Bruder, & D. Iwai (Eds.), International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017 (pp. 221-228). (International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017). Eurographics Association. https://doi.org/10.2312/egve.20171362