Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition

Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

With the emergence of the wearable devices, the method to make use of the limited input space is required. This paper presents an input technique to a computer by rubbing face using optical sensors on smart eyewear. Since rubbing gesture occurs in daily life, our system enables a subtle interaction between the user and a computer. We used the smart eyewear based on the work by [5]. Although the device is developed for facial expression recognition, our method can recognize rubbing gesture independent from facial expression recognition. The embedded optical sensors measure the skin deformation caused by rubbing on the face. We detect the gestures using principal component analysis (PCA) and peak detection. we classify the area of the gesture with a random forest classifier. The accuracy of detecting rubbing gesture is 97.5%. The classification accuracy of 10 gesture area is 88.7% with user-independent training. The system can open up a new interaction method for smart glasses.

Original languageEnglish
Title of host publicationProceedings of the 9th Augmented Human International Conference, AH 2018
PublisherAssociation for Computing Machinery
VolumePart F134484
ISBN (Electronic)9781450354158
DOIs
Publication statusPublished - 2018 Feb 6
Event9th Augmented Human International Conference, AH 2018 - Seoul, Korea, Republic of
Duration: 2018 Feb 72018 Feb 9

Other

Other9th Augmented Human International Conference, AH 2018
CountryKorea, Republic of
CitySeoul
Period18/2/718/2/9

Keywords

  • Eyewear Computing
  • Input Technique
  • Wearable Computing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition'. Together they form a unique fingerprint.

  • Cite this

    Masai, K., Sugiura, Y., & Sugimoto, M. (2018). Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition. In Proceedings of the 9th Augmented Human International Conference, AH 2018 (Vol. Part F134484). [a23] Association for Computing Machinery. https://doi.org/10.1145/3174910.3174924