TY - GEN
T1 - 3D reconstruction of hand postures by measuring skin deformation on back hand
AU - Kuno, Wakaba
AU - Sugiura, Yuta
AU - Asano, Nao
AU - Kawai, Wataru
AU - Sugimoto, Maki
N1 - Funding Information:
This work was supported by JSPS KAKENHI Grant Numbers JP16H01741, JP16H05870.
PY - 2017
Y1 - 2017
N2 - In this research, we propose a method for reconstructing hand posture by measuring the deformation of the back of the hand with a wearable device. The deformation of skin on the back of the hand can be measured by using several photo-reflective sensors attached to a wearable device. In the learning phase, our method constructs a regression model by using the data on hand posture captured by a depth camera and data on the skin deformation of the back of the hand captured by several photoreflective sensors. In the estimation phase, by using this regression model, the posture of the hand is reconstructed from the data of the photo-reflective sensors in real-time. The posture of fingers can be estimated without hindering the natural movement of the fingers since the deformation of the back of the hand is measured without directly measuring the position of the fingers. This method can be used by users to manipulate information in a virtual environment with their fingers. We conducted an experiment to evaluate the accuracy of reconstructing hand posture with the proposed system.
AB - In this research, we propose a method for reconstructing hand posture by measuring the deformation of the back of the hand with a wearable device. The deformation of skin on the back of the hand can be measured by using several photo-reflective sensors attached to a wearable device. In the learning phase, our method constructs a regression model by using the data on hand posture captured by a depth camera and data on the skin deformation of the back of the hand captured by several photoreflective sensors. In the estimation phase, by using this regression model, the posture of the hand is reconstructed from the data of the photo-reflective sensors in real-time. The posture of fingers can be estimated without hindering the natural movement of the fingers since the deformation of the back of the hand is measured without directly measuring the position of the fingers. This method can be used by users to manipulate information in a virtual environment with their fingers. We conducted an experiment to evaluate the accuracy of reconstructing hand posture with the proposed system.
UR - http://www.scopus.com/inward/record.url?scp=85086800820&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85086800820&partnerID=8YFLogxK
U2 - 10.2312/egve.20171362
DO - 10.2312/egve.20171362
M3 - Conference contribution
AN - SCOPUS:85086800820
T3 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017
SP - 221
EP - 228
BT - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments, ICAT-EGVE 2017
A2 - Lindeman, Robert W.
A2 - Bruder, Gerd
A2 - Iwai, Daisuke
PB - Eurographics Association
T2 - 27th International Conference on Artificial Reality and Telexistence, ICAT 2017 and the 22nd Eurographics Symposium on Virtual Environments, EGVE 2017
Y2 - 22 November 2017 through 24 November 2017
ER -