Facial expression mapping inside head mounted display by embedded optical sensors

Katsuhiro Suzuki, Fumihiko Nakamura, Jiu Otsuka, Katsutoshi Masai, Yuta Itoh, Yuta Sugiura, Maki Sugimoto

研究成果: Conference contribution

5 被引用数 (Scopus)

抄録

Head Mounted Display (HMD) provides an immersive ex-perience in virtual environments for various purposes such as for games and communication. However, it is difficult to capture facial expression in a HMD-based virtual environ-ment because the upper half of user's face is covered up by the HMD. In this paper, we propose a facial expression mapping technology between user and a virtual avatar using embedded optical sensors and machine learning. The dis-tance between each sensor and surface of the face is meas-ured by the optical sensors that are attached inside the HMD. Our system learns the sensor values of each facial expression by neural network and creates a classifier to estimate the current facial expression.

本文言語English
ホスト出版物のタイトルUIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology
出版社Association for Computing Machinery, Inc
ページ91-92
ページ数2
ISBN(電子版)9781450345316
DOI
出版ステータスPublished - 2016 10月 16
イベント29th Annual Symposium on User Interface Software and Technology, UIST 2016 - Tokyo, Japan
継続期間: 2016 10月 162016 10月 19

出版物シリーズ

名前UIST 2016 Adjunct - Proceedings of the 29th Annual Symposium on User Interface Software and Technology

Other

Other29th Annual Symposium on User Interface Software and Technology, UIST 2016
国/地域Japan
CityTokyo
Period16/10/1616/10/19

ASJC Scopus subject areas

  • ソフトウェア
  • 人間とコンピュータの相互作用

フィンガープリント

「Facial expression mapping inside head mounted display by embedded optical sensors」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル