FaceDrive: Facial expression driven operation to control virtual supernumerary robotic arms

Masaaki Fukuoka, Adrien Verhulst, Fumihiko Nakamura, Ryo Takizawa, Katsutoshi Masai, Maki Sugimoto

研究成果: Conference contribution

抄録

Supernumerary Robotic Arms (SRAs) can make physical activities easier, but require cooperation with the operator. To improve cooperation, we predict the operator's intentions by using his/her Facial Expressions (FEs).We propose to map FEs to SRAs commands (e.g. grab, release). To measure FEs, we used a optical sensor-based approach (here inside a HMD), the sensors data are fed to a SVM classifying them in FEs. The SRAs can then carry out commands by predicting the operator's FEs (and arguably, the operator's intention). We made a Virtual reality Environment (VE) with SRAs and synchronizable avatar to investigate the most suitable mapping between FEs and SRAs. In SIGGRAPH Asia 2019, the user can manipulate virtual SRAs using his/her FEs.

本文言語English
ホスト出版物のタイトルSIGGRAPH Asia 2019 XR, SA 2019
出版社Association for Computing Machinery, Inc
ページ9-10
ページ数2
ISBN(電子版)9781450369473
DOI
出版ステータスPublished - 2019 11 17
イベントSIGGRAPH Asia 2019 XR - International Conference on Computer Graphics and Interactive Techniques, SA 2019 - Brisbane, Australia
継続期間: 2019 11 172019 11 20

出版物シリーズ

名前SIGGRAPH Asia 2019 XR, SA 2019

Conference

ConferenceSIGGRAPH Asia 2019 XR - International Conference on Computer Graphics and Interactive Techniques, SA 2019
CountryAustralia
CityBrisbane
Period19/11/1719/11/20

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

フィンガープリント 「FaceDrive: Facial expression driven operation to control virtual supernumerary robotic arms」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル