Affective wear: Toward recognizing facial expression

Katsutoshi Masai, Yuta Sugiura, Masa Ogata, Katsuhiro Suzuki, Fumihiko Nakamura, Sho Shimamura, Kai Steven Kunze, Masahiko Inami, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Facial expression is a powerful way for us to exchange information nonverbally. They can give us insights into how people feel and think. There are a number of works related to facial expression detection in computer vision. However, most works focus on camera-based systems installed in the environment. With this method, it is difficult to track user's face if user moves constantly. Moreover, user's facial expression can be recognized at only a limited place. We present the eyewear that can detect facial expression anytime, anywhere (Figure 1 a). This eyewear can categorize 7 facial expressions by measuring the distance between an eyewear frame and a skin surface of a person's face with 8 photo reflective sensors. Recognizable states are as follows: neutral, smile, laugh, disgust, angry, sad and surprise. With our method, an individual difference can be ignored with user-dependent training. Several works show the wearable systems that can recognize facial expression. Yet, these works focus on detecting only one specific facial expression. Our contribution is detecting 7 facial expression states in daily life. With our device, user can better understand their mind, and computing systems can tap into the rich set of information provided by nonverbal communication.

Original languageEnglish
Title of host publicationACM SIGGRAPH 2015 Posters, SIGGRAPH 2015
PublisherAssociation for Computing Machinery, Inc
ISBN (Print)9781450336321
DOIs
Publication statusPublished - 2015 Jul 31
EventInternational Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2015 - Los Angeles, United States
Duration: 2015 Aug 92015 Aug 13

Other

OtherInternational Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2015
CountryUnited States
CityLos Angeles
Period15/8/915/8/13

Fingerprint

Computer vision
Skin
Cameras
Wear of materials
Communication
Sensors

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Cite this

Masai, K., Sugiura, Y., Ogata, M., Suzuki, K., Nakamura, F., Shimamura, S., ... Sugimoto, M. (2015). Affective wear: Toward recognizing facial expression. In ACM SIGGRAPH 2015 Posters, SIGGRAPH 2015 [a16] Association for Computing Machinery, Inc. https://doi.org/10.1145/2787626.2792632

Affective wear : Toward recognizing facial expression. / Masai, Katsutoshi; Sugiura, Yuta; Ogata, Masa; Suzuki, Katsuhiro; Nakamura, Fumihiko; Shimamura, Sho; Kunze, Kai Steven; Inami, Masahiko; Sugimoto, Maki.

ACM SIGGRAPH 2015 Posters, SIGGRAPH 2015. Association for Computing Machinery, Inc, 2015. a16.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Masai, K, Sugiura, Y, Ogata, M, Suzuki, K, Nakamura, F, Shimamura, S, Kunze, KS, Inami, M & Sugimoto, M 2015, Affective wear: Toward recognizing facial expression. in ACM SIGGRAPH 2015 Posters, SIGGRAPH 2015., a16, Association for Computing Machinery, Inc, International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2015, Los Angeles, United States, 15/8/9. https://doi.org/10.1145/2787626.2792632
Masai K, Sugiura Y, Ogata M, Suzuki K, Nakamura F, Shimamura S et al. Affective wear: Toward recognizing facial expression. In ACM SIGGRAPH 2015 Posters, SIGGRAPH 2015. Association for Computing Machinery, Inc. 2015. a16 https://doi.org/10.1145/2787626.2792632
Masai, Katsutoshi ; Sugiura, Yuta ; Ogata, Masa ; Suzuki, Katsuhiro ; Nakamura, Fumihiko ; Shimamura, Sho ; Kunze, Kai Steven ; Inami, Masahiko ; Sugimoto, Maki. / Affective wear : Toward recognizing facial expression. ACM SIGGRAPH 2015 Posters, SIGGRAPH 2015. Association for Computing Machinery, Inc, 2015.
@inproceedings{22405361636449c4acb49e736fe9634b,
title = "Affective wear: Toward recognizing facial expression",
abstract = "Facial expression is a powerful way for us to exchange information nonverbally. They can give us insights into how people feel and think. There are a number of works related to facial expression detection in computer vision. However, most works focus on camera-based systems installed in the environment. With this method, it is difficult to track user's face if user moves constantly. Moreover, user's facial expression can be recognized at only a limited place. We present the eyewear that can detect facial expression anytime, anywhere (Figure 1 a). This eyewear can categorize 7 facial expressions by measuring the distance between an eyewear frame and a skin surface of a person's face with 8 photo reflective sensors. Recognizable states are as follows: neutral, smile, laugh, disgust, angry, sad and surprise. With our method, an individual difference can be ignored with user-dependent training. Several works show the wearable systems that can recognize facial expression. Yet, these works focus on detecting only one specific facial expression. Our contribution is detecting 7 facial expression states in daily life. With our device, user can better understand their mind, and computing systems can tap into the rich set of information provided by nonverbal communication.",
author = "Katsutoshi Masai and Yuta Sugiura and Masa Ogata and Katsuhiro Suzuki and Fumihiko Nakamura and Sho Shimamura and Kunze, {Kai Steven} and Masahiko Inami and Maki Sugimoto",
year = "2015",
month = "7",
day = "31",
doi = "10.1145/2787626.2792632",
language = "English",
isbn = "9781450336321",
booktitle = "ACM SIGGRAPH 2015 Posters, SIGGRAPH 2015",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Affective wear

T2 - Toward recognizing facial expression

AU - Masai, Katsutoshi

AU - Sugiura, Yuta

AU - Ogata, Masa

AU - Suzuki, Katsuhiro

AU - Nakamura, Fumihiko

AU - Shimamura, Sho

AU - Kunze, Kai Steven

AU - Inami, Masahiko

AU - Sugimoto, Maki

PY - 2015/7/31

Y1 - 2015/7/31

N2 - Facial expression is a powerful way for us to exchange information nonverbally. They can give us insights into how people feel and think. There are a number of works related to facial expression detection in computer vision. However, most works focus on camera-based systems installed in the environment. With this method, it is difficult to track user's face if user moves constantly. Moreover, user's facial expression can be recognized at only a limited place. We present the eyewear that can detect facial expression anytime, anywhere (Figure 1 a). This eyewear can categorize 7 facial expressions by measuring the distance between an eyewear frame and a skin surface of a person's face with 8 photo reflective sensors. Recognizable states are as follows: neutral, smile, laugh, disgust, angry, sad and surprise. With our method, an individual difference can be ignored with user-dependent training. Several works show the wearable systems that can recognize facial expression. Yet, these works focus on detecting only one specific facial expression. Our contribution is detecting 7 facial expression states in daily life. With our device, user can better understand their mind, and computing systems can tap into the rich set of information provided by nonverbal communication.

AB - Facial expression is a powerful way for us to exchange information nonverbally. They can give us insights into how people feel and think. There are a number of works related to facial expression detection in computer vision. However, most works focus on camera-based systems installed in the environment. With this method, it is difficult to track user's face if user moves constantly. Moreover, user's facial expression can be recognized at only a limited place. We present the eyewear that can detect facial expression anytime, anywhere (Figure 1 a). This eyewear can categorize 7 facial expressions by measuring the distance between an eyewear frame and a skin surface of a person's face with 8 photo reflective sensors. Recognizable states are as follows: neutral, smile, laugh, disgust, angry, sad and surprise. With our method, an individual difference can be ignored with user-dependent training. Several works show the wearable systems that can recognize facial expression. Yet, these works focus on detecting only one specific facial expression. Our contribution is detecting 7 facial expression states in daily life. With our device, user can better understand their mind, and computing systems can tap into the rich set of information provided by nonverbal communication.

UR - http://www.scopus.com/inward/record.url?scp=84959331782&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84959331782&partnerID=8YFLogxK

U2 - 10.1145/2787626.2792632

DO - 10.1145/2787626.2792632

M3 - Conference contribution

AN - SCOPUS:84959331782

SN - 9781450336321

BT - ACM SIGGRAPH 2015 Posters, SIGGRAPH 2015

PB - Association for Computing Machinery, Inc

ER -