Facial expression recognition in daily life by embedded photo reflective sensors on smart eyewear

Katsutoshi Masai, Yuta Sugiura, Masa Ogata, Kai Kunze, Masahiko Inami, Maki Sugimoto

研究成果: Conference contribution

39 被引用数 (Scopus)

抄録

This paper presents a novel smart eyewear that uses embedded photo reflective sensors and machine learning to recognize a wearer's facial expressions in daily life. We leverage the skin deformation when wearers change their facial expressions. With small photo reflective sensors, we measure the proximity between the skin surface on a face and the eyewear frame where 17 sensors are integrated. A Support Vector Ma- chine (SVM) algorithm was applied for the sensor information. The sensors can cover various facial muscle movements and can be integrated into everyday glasses. The main contributions of our work are as follows. (1) The eyewear recognizes eight facial expressions (92.8% accuracy for one time use and 78.1% for use on 3 different days). (2) It is designed and implemented considering social acceptability. The device looks like normal eyewear, so users can wear it anytime, anywhere. (3) Initial field trials in daily life were undertaken. Our work is one of the first attempts to recognize and evaluate a variety of facial expressions in the form of an unobtrusive wearable device.

本文言語English
ホスト出版物のタイトルIUI 2016 Companion - Proceedings of the 21st International Conference on Intelligent User Interfaces
出版社Association for Computing Machinery
ページ317-326
ページ数10
ISBN(電子版)9781450341370, 9781450341400
DOI
出版ステータスPublished - 2016 3 7
イベント21st International Conference on Intelligent User Interfaces, IUI 2016 - Sonoma, United States
継続期間: 2016 3 72016 3 10

出版物シリーズ

名前International Conference on Intelligent User Interfaces, Proceedings IUI
07-10-March-2016

Other

Other21st International Conference on Intelligent User Interfaces, IUI 2016
国/地域United States
CitySonoma
Period16/3/716/3/10

ASJC Scopus subject areas

  • ソフトウェア
  • 人間とコンピュータの相互作用

フィンガープリント

「Facial expression recognition in daily life by embedded photo reflective sensors on smart eyewear」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル