TY - GEN
T1 - FaceDrive
T2 - SIGGRAPH Asia 2019 XR - International Conference on Computer Graphics and Interactive Techniques, SA 2019
AU - Fukuoka, Masaaki
AU - Verhulst, Adrien
AU - Nakamura, Fumihiko
AU - Takizawa, Ryo
AU - Masai, Katsutoshi
AU - Sugimoto, Maki
N1 - Funding Information:
This work was supported by JST ERATO(JPMJER1701).
Publisher Copyright:
© 2019 Association for Computing Machinery.
PY - 2019/11/17
Y1 - 2019/11/17
N2 - Supernumerary Robotic Arms (SRAs) can make physical activities easier, but require cooperation with the operator. To improve cooperation, we predict the operator's intentions by using his/her Facial Expressions (FEs).We propose to map FEs to SRAs commands (e.g. grab, release). To measure FEs, we used a optical sensor-based approach (here inside a HMD), the sensors data are fed to a SVM classifying them in FEs. The SRAs can then carry out commands by predicting the operator's FEs (and arguably, the operator's intention). We made a Virtual reality Environment (VE) with SRAs and synchronizable avatar to investigate the most suitable mapping between FEs and SRAs. In SIGGRAPH Asia 2019, the user can manipulate virtual SRAs using his/her FEs.
AB - Supernumerary Robotic Arms (SRAs) can make physical activities easier, but require cooperation with the operator. To improve cooperation, we predict the operator's intentions by using his/her Facial Expressions (FEs).We propose to map FEs to SRAs commands (e.g. grab, release). To measure FEs, we used a optical sensor-based approach (here inside a HMD), the sensors data are fed to a SVM classifying them in FEs. The SRAs can then carry out commands by predicting the operator's FEs (and arguably, the operator's intention). We made a Virtual reality Environment (VE) with SRAs and synchronizable avatar to investigate the most suitable mapping between FEs and SRAs. In SIGGRAPH Asia 2019, the user can manipulate virtual SRAs using his/her FEs.
KW - Augmented human
KW - Datasets
KW - Support vector machine
UR - http://www.scopus.com/inward/record.url?scp=85076609545&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85076609545&partnerID=8YFLogxK
U2 - 10.1145/3355355.3361888
DO - 10.1145/3355355.3361888
M3 - Conference contribution
AN - SCOPUS:85076609545
T3 - SIGGRAPH Asia 2019 XR, SA 2019
SP - 9
EP - 10
BT - SIGGRAPH Asia 2019 XR, SA 2019
PB - Association for Computing Machinery, Inc
Y2 - 17 November 2019 through 20 November 2019
ER -