FaceDrive: Facial expression driven operation to control virtual supernumerary robotic arms

Masaaki Fukuoka, Adrien Verhulst, Fumihiko Nakamura, Ryo Takizawa, Katsutoshi Masai, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Supernumerary Robotic Arms (SRAs) can make physical activities easier, but require cooperation with the operator. To improve cooperation, we predict the operator's intentions by using his/her Facial Expressions (FEs).We propose to map FEs to SRAs commands (e.g. grab, release). To measure FEs, we used a optical sensor-based approach (here inside a HMD), the sensors data are fed to a SVM classifying them in FEs. The SRAs can then carry out commands by predicting the operator's FEs (and arguably, the operator's intention). We made a Virtual reality Environment (VE) with SRAs and synchronizable avatar to investigate the most suitable mapping between FEs and SRAs. In SIGGRAPH Asia 2019, the user can manipulate virtual SRAs using his/her FEs.

Original languageEnglish
Title of host publicationSIGGRAPH Asia 2019 XR, SA 2019
PublisherAssociation for Computing Machinery, Inc
Pages9-10
Number of pages2
ISBN (Electronic)9781450369473
DOIs
Publication statusPublished - 2019 Nov 17
EventSIGGRAPH Asia 2019 XR - International Conference on Computer Graphics and Interactive Techniques, SA 2019 - Brisbane, Australia
Duration: 2019 Nov 172019 Nov 20

Publication series

NameSIGGRAPH Asia 2019 XR, SA 2019

Conference

ConferenceSIGGRAPH Asia 2019 XR - International Conference on Computer Graphics and Interactive Techniques, SA 2019
CountryAustralia
CityBrisbane
Period19/11/1719/11/20

Keywords

  • Augmented human
  • Datasets
  • Support vector machine

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'FaceDrive: Facial expression driven operation to control virtual supernumerary robotic arms'. Together they form a unique fingerprint.

  • Cite this

    Fukuoka, M., Verhulst, A., Nakamura, F., Takizawa, R., Masai, K., & Sugimoto, M. (2019). FaceDrive: Facial expression driven operation to control virtual supernumerary robotic arms. In SIGGRAPH Asia 2019 XR, SA 2019 (pp. 9-10). (SIGGRAPH Asia 2019 XR, SA 2019). Association for Computing Machinery, Inc. https://doi.org/10.1145/3355355.3361888