Facial expression recognition in daily life by embedded photo reflective sensors on smart eyewear

Katsutoshi Masai, Yuta Sugiura, Masa Ogata, Kai Kunze, Masahiko Inami, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

30 Citations (Scopus)

Abstract

This paper presents a novel smart eyewear that uses embedded photo reflective sensors and machine learning to recognize a wearer's facial expressions in daily life. We leverage the skin deformation when wearers change their facial expressions. With small photo reflective sensors, we measure the proximity between the skin surface on a face and the eyewear frame where 17 sensors are integrated. A Support Vector Ma- chine (SVM) algorithm was applied for the sensor information. The sensors can cover various facial muscle movements and can be integrated into everyday glasses. The main contributions of our work are as follows. (1) The eyewear recognizes eight facial expressions (92.8% accuracy for one time use and 78.1% for use on 3 different days). (2) It is designed and implemented considering social acceptability. The device looks like normal eyewear, so users can wear it anytime, anywhere. (3) Initial field trials in daily life were undertaken. Our work is one of the first attempts to recognize and evaluate a variety of facial expressions in the form of an unobtrusive wearable device.

Original languageEnglish
Title of host publicationInternational Conference on Intelligent User Interfaces, Proceedings IUI
PublisherAssociation for Computing Machinery
Pages317-326
Number of pages10
Volume07-10-March-2016
ISBN (Print)9781450341370, 9781450341400
DOIs
Publication statusPublished - 2016 Mar 7
Event21st International Conference on Intelligent User Interfaces, IUI 2016 - Sonoma, United States
Duration: 2016 Mar 72016 Mar 10

Other

Other21st International Conference on Intelligent User Interfaces, IUI 2016
CountryUnited States
CitySonoma
Period16/3/716/3/10

Keywords

  • Eyewear Computing
  • Facial Expression Recognition
  • Smart Eye Glasses
  • Wearable

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Fingerprint Dive into the research topics of 'Facial expression recognition in daily life by embedded photo reflective sensors on smart eyewear'. Together they form a unique fingerprint.

  • Cite this

    Masai, K., Sugiura, Y., Ogata, M., Kunze, K., Inami, M., & Sugimoto, M. (2016). Facial expression recognition in daily life by embedded photo reflective sensors on smart eyewear. In International Conference on Intelligent User Interfaces, Proceedings IUI (Vol. 07-10-March-2016, pp. 317-326). Association for Computing Machinery. https://doi.org/10.1145/2856767.2856770