Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With the emergence of the wearable devices, the method to make use of the limited input space is required. This paper presents an input technique to a computer by rubbing face using optical sensors on smart eyewear. Since rubbing gesture occurs in daily life, our system enables a subtle interaction between the user and a computer. We used the smart eyewear based on the work by [5]. Although the device is developed for facial expression recognition, our method can recognize rubbing gesture independent from facial expression recognition. The embedded optical sensors measure the skin deformation caused by rubbing on the face. We detect the gestures using principal component analysis (PCA) and peak detection. we classify the area of the gesture with a random forest classifier. The accuracy of detecting rubbing gesture is 97.5%. The classification accuracy of 10 gesture area is 88.7% with user-independent training. The system can open up a new interaction method for smart glasses.

Original languageEnglish
Title of host publicationProceedings of the 9th Augmented Human International Conference, AH 2018
PublisherAssociation for Computing Machinery
VolumePart F134484
ISBN (Electronic)9781450354158
DOIs
Publication statusPublished - 2018 Feb 6
Event9th Augmented Human International Conference, AH 2018 - Seoul, Korea, Republic of
Duration: 2018 Feb 72018 Feb 9

Other

Other9th Augmented Human International Conference, AH 2018
CountryKorea, Republic of
CitySeoul
Period18/2/718/2/9

Fingerprint

Optical sensors
Open systems
Principal component analysis
Skin
Classifiers
Glass

Keywords

  • Eyewear Computing
  • Input Technique
  • Wearable Computing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Masai, K., Sugiura, Y., & Sugimoto, M. (2018). Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition. In Proceedings of the 9th Augmented Human International Conference, AH 2018 (Vol. Part F134484). [a23] Association for Computing Machinery. https://doi.org/10.1145/3174910.3174924

Facerubbing : Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition. / Masai, Katsutoshi; Sugiura, Yuta; Sugimoto, Maki.

Proceedings of the 9th Augmented Human International Conference, AH 2018. Vol. Part F134484 Association for Computing Machinery, 2018. a23.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Masai, K, Sugiura, Y & Sugimoto, M 2018, Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition. in Proceedings of the 9th Augmented Human International Conference, AH 2018. vol. Part F134484, a23, Association for Computing Machinery, 9th Augmented Human International Conference, AH 2018, Seoul, Korea, Republic of, 18/2/7. https://doi.org/10.1145/3174910.3174924
Masai K, Sugiura Y, Sugimoto M. Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition. In Proceedings of the 9th Augmented Human International Conference, AH 2018. Vol. Part F134484. Association for Computing Machinery. 2018. a23 https://doi.org/10.1145/3174910.3174924
Masai, Katsutoshi ; Sugiura, Yuta ; Sugimoto, Maki. / Facerubbing : Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition. Proceedings of the 9th Augmented Human International Conference, AH 2018. Vol. Part F134484 Association for Computing Machinery, 2018.
@inproceedings{c71baad439d24433b9026c62301c0f7a,
title = "Facerubbing: Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition",
abstract = "With the emergence of the wearable devices, the method to make use of the limited input space is required. This paper presents an input technique to a computer by rubbing face using optical sensors on smart eyewear. Since rubbing gesture occurs in daily life, our system enables a subtle interaction between the user and a computer. We used the smart eyewear based on the work by [5]. Although the device is developed for facial expression recognition, our method can recognize rubbing gesture independent from facial expression recognition. The embedded optical sensors measure the skin deformation caused by rubbing on the face. We detect the gestures using principal component analysis (PCA) and peak detection. we classify the area of the gesture with a random forest classifier. The accuracy of detecting rubbing gesture is 97.5{\%}. The classification accuracy of 10 gesture area is 88.7{\%} with user-independent training. The system can open up a new interaction method for smart glasses.",
keywords = "Eyewear Computing, Input Technique, Wearable Computing",
author = "Katsutoshi Masai and Yuta Sugiura and Maki Sugimoto",
year = "2018",
month = "2",
day = "6",
doi = "10.1145/3174910.3174924",
language = "English",
volume = "Part F134484",
booktitle = "Proceedings of the 9th Augmented Human International Conference, AH 2018",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Facerubbing

T2 - Input technique by rubbing face using optical sensors on smart eyewear for facial expression recognition

AU - Masai, Katsutoshi

AU - Sugiura, Yuta

AU - Sugimoto, Maki

PY - 2018/2/6

Y1 - 2018/2/6

N2 - With the emergence of the wearable devices, the method to make use of the limited input space is required. This paper presents an input technique to a computer by rubbing face using optical sensors on smart eyewear. Since rubbing gesture occurs in daily life, our system enables a subtle interaction between the user and a computer. We used the smart eyewear based on the work by [5]. Although the device is developed for facial expression recognition, our method can recognize rubbing gesture independent from facial expression recognition. The embedded optical sensors measure the skin deformation caused by rubbing on the face. We detect the gestures using principal component analysis (PCA) and peak detection. we classify the area of the gesture with a random forest classifier. The accuracy of detecting rubbing gesture is 97.5%. The classification accuracy of 10 gesture area is 88.7% with user-independent training. The system can open up a new interaction method for smart glasses.

AB - With the emergence of the wearable devices, the method to make use of the limited input space is required. This paper presents an input technique to a computer by rubbing face using optical sensors on smart eyewear. Since rubbing gesture occurs in daily life, our system enables a subtle interaction between the user and a computer. We used the smart eyewear based on the work by [5]. Although the device is developed for facial expression recognition, our method can recognize rubbing gesture independent from facial expression recognition. The embedded optical sensors measure the skin deformation caused by rubbing on the face. We detect the gestures using principal component analysis (PCA) and peak detection. we classify the area of the gesture with a random forest classifier. The accuracy of detecting rubbing gesture is 97.5%. The classification accuracy of 10 gesture area is 88.7% with user-independent training. The system can open up a new interaction method for smart glasses.

KW - Eyewear Computing

KW - Input Technique

KW - Wearable Computing

UR - http://www.scopus.com/inward/record.url?scp=85044277648&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044277648&partnerID=8YFLogxK

U2 - 10.1145/3174910.3174924

DO - 10.1145/3174910.3174924

M3 - Conference contribution

AN - SCOPUS:85044277648

VL - Part F134484

BT - Proceedings of the 9th Augmented Human International Conference, AH 2018

PB - Association for Computing Machinery

ER -