Eye-based Interaction Using Embedded Optical Sensors on an Eyewear Device for Facial Expression Recognition

Katsutoshi Masai, Kai Kunze, Maki Sugimoto

研究成果: Conference contribution

抄録

Non-verbal information is essential to understand intentions and emotions and to facilitate social interaction between humans and between humans and computers. One reliable source of such information is the eyes. We investigated the eye-based interaction (recognizing eye gestures or eye movements) using an eyewear device for facial expression recognition. The device incorporates 16 low-cost optical sensors. The system allows hands-free interaction in many situations. Using the device, we evaluated three eye-based interactions. First, we evaluated the accuracy of detecting the gestures with nine participants. The average accuracy of detecting seven different eye gestures is 89.1% with user-dependent training. We used dynamic time warping (DTW) for gesture recognition. Second, we evaluated the accuracy of eye gaze position estimation with five users holding a neutral face. The system showed potential to track the approximate direction of the eyes, with higher accuracy in detecting position y than x. Finally, we did a feasibility study of one user reading jokes while wearing the device. The system was capable of analyzing facial expressions and eye movements in daily contexts.

本文言語English
ホスト出版物のタイトルProceedings of the Augmented Humans International Conference, AHs 2020
出版社Association for Computing Machinery
ISBN(電子版)9781450376037
DOI
出版ステータスPublished - 2020 3 16
イベント2020 Augmented Humans International Conference, AHs 2020 - Kaiserslautern, Germany
継続期間: 2020 3 162020 3 17

出版物シリーズ

名前ACM International Conference Proceeding Series

Conference

Conference2020 Augmented Humans International Conference, AHs 2020
CountryGermany
CityKaiserslautern
Period20/3/1620/3/17

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

フィンガープリント 「Eye-based Interaction Using Embedded Optical Sensors on an Eyewear Device for Facial Expression Recognition」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル