Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.

Original languageEnglish
Title of host publicationUbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers
PublisherAssociation for Computing Machinery, Inc
Pages158-161
Number of pages4
ISBN (Electronic)9781450359665
DOIs
Publication statusPublished - 2018 Oct 8
Event2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018 - Singapore, Singapore
Duration: 2018 Oct 82018 Oct 12

Other

Other2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018
CountrySingapore
CitySingapore
Period18/10/818/10/12

Fingerprint

Unsupervised learning
Optical sensors
Communication
Self organizing maps

Keywords

  • Facial Expression
  • Unsupervised Learning
  • Wearable Computing

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Information Systems

Cite this

Masai, K., Kunze, K. S., Sugiura, Y., & Sugimoto, M. (2018). Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. In UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers (pp. 158-161). Association for Computing Machinery, Inc. https://doi.org/10.1145/3267305.3267562

Poster : Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. / Masai, Katsutoshi; Kunze, Kai Steven; Sugiura, Yuta; Sugimoto, Maki.

UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, 2018. p. 158-161.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Masai, K, Kunze, KS, Sugiura, Y & Sugimoto, M 2018, Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. in UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, pp. 158-161, 2018 Joint ACM International Conference on Pervasive and Ubiquitous Computing, UbiComp 2018 and 2018 ACM International Symposium on Wearable Computers, ISWC 2018, Singapore, Singapore, 18/10/8. https://doi.org/10.1145/3267305.3267562
Masai K, Kunze KS, Sugiura Y, Sugimoto M. Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. In UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc. 2018. p. 158-161 https://doi.org/10.1145/3267305.3267562
Masai, Katsutoshi ; Kunze, Kai Steven ; Sugiura, Yuta ; Sugimoto, Maki. / Poster : Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear. UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers. Association for Computing Machinery, Inc, 2018. pp. 158-161
@inproceedings{861067cc10704b9b996205f593f8109c,
title = "Poster: Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear",
abstract = "Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.",
keywords = "Facial Expression, Unsupervised Learning, Wearable Computing",
author = "Katsutoshi Masai and Kunze, {Kai Steven} and Yuta Sugiura and Maki Sugimoto",
year = "2018",
month = "10",
day = "8",
doi = "10.1145/3267305.3267562",
language = "English",
pages = "158--161",
booktitle = "UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Poster

T2 - Mapping natural facial expressions using unsupervised learning and optical sensors on smart eyewear

AU - Masai, Katsutoshi

AU - Kunze, Kai Steven

AU - Sugiura, Yuta

AU - Sugimoto, Maki

PY - 2018/10/8

Y1 - 2018/10/8

N2 - Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.

AB - Our communication highly depends on nonverbal clues, especially on facial expressions. This paper presents the mapping of spontaneous facial expressions in daily conversation using the optical sensors on smart eyewear and unsupervised learning method(Self-Organizing Map) to see the potentially detectable expressions. We had the case study of five to ten minutes of the unscripted communications with five users. It showed that our system could map the various facial expressions of the users such as social smile and the smile of enjoyment. The study also demonstrated that the map trained with the datasets of five users could categorize the similar expressions of each user into the shared clusters among the users.

KW - Facial Expression

KW - Unsupervised Learning

KW - Wearable Computing

UR - http://www.scopus.com/inward/record.url?scp=85058294541&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058294541&partnerID=8YFLogxK

U2 - 10.1145/3267305.3267562

DO - 10.1145/3267305.3267562

M3 - Conference contribution

AN - SCOPUS:85058294541

SP - 158

EP - 161

BT - UbiComp/ISWC 2018 - Adjunct Proceedings of the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2018 ACM International Symposium on Wearable Computers

PB - Association for Computing Machinery, Inc

ER -