E2-MaskZ: A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors

Akino Umezawa; Yoshinari Takegawa; Katsuhiro Suzuki; Katsutoshi Masai; Yuta Sugiura; Maki Sugimoto; Yutaka Tokuda; Diego Martinez Plasencia; Sriram Subramanian; Masafumi Takahashi; Hiroaki Taka; Keiji Hirata

doi:10.1145/3384657.3385332

E2-MaskZ: A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors

Akino Umezawa, Yoshinari Takegawa, Katsuhiro Suzuki, Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto, Yutaka Tokuda, Diego Martinez Plasencia, Sriram Subramanian, Masafumi Takahashi, Hiroaki Taka, Keiji Hirata

Department of Information and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.

Original language	English
Title of host publication	Proceedings of the Augmented Humans International Conference, AHs 2020
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450376037
DOIs	https://doi.org/10.1145/3384657.3385332
Publication status	Published - 2020 Mar 16
Event	2020 Augmented Humans International Conference, AHs 2020 - Kaiserslautern, Germany Duration: 2020 Mar 16 → 2020 Mar 17

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	2020 Augmented Humans International Conference, AHs 2020
Country/Territory	Germany
City	Kaiserslautern
Period	20/3/16 → 20/3/17

Keywords

Augmented Face
Communication
Human Agent Interaction

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Vision and Pattern Recognition
Computer Networks and Communications

Access to Document

10.1145/3384657.3385332

Cite this

Umezawa, A., Takegawa, Y., Suzuki, K., Masai, K., Sugiura, Y., Sugimoto, M., Tokuda, Y., Plasencia, D. M., Subramanian, S., Takahashi, M., Taka, H., & Hirata, K. (2020). E2-MaskZ: A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. In Proceedings of the Augmented Humans International Conference, AHs 2020 (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3384657.3385332

E2-MaskZ : A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. / Umezawa, Akino; Takegawa, Yoshinari; Suzuki, Katsuhiro; Masai, Katsutoshi; Sugiura, Yuta ; Sugimoto, Maki; Tokuda, Yutaka; Plasencia, Diego Martinez; Subramanian, Sriram; Takahashi, Masafumi; Taka, Hiroaki; Hirata, Keiji.

Proceedings of the Augmented Humans International Conference, AHs 2020. Association for Computing Machinery, 2020. (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Umezawa, A, Takegawa, Y, Suzuki, K, Masai, K, Sugiura, Y , Sugimoto, M, Tokuda, Y, Plasencia, DM, Subramanian, S, Takahashi, M, Taka, H & Hirata, K 2020, E2-MaskZ: A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. in Proceedings of the Augmented Humans International Conference, AHs 2020. ACM International Conference Proceeding Series, Association for Computing Machinery, 2020 Augmented Humans International Conference, AHs 2020, Kaiserslautern, Germany, 20/3/16. https://doi.org/10.1145/3384657.3385332

Umezawa A, Takegawa Y, Suzuki K, Masai K, Sugiura Y , Sugimoto M et al. E2-MaskZ: A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. In Proceedings of the Augmented Humans International Conference, AHs 2020. Association for Computing Machinery. 2020. (ACM International Conference Proceeding Series). https://doi.org/10.1145/3384657.3385332

Umezawa, Akino ; Takegawa, Yoshinari ; Suzuki, Katsuhiro ; Masai, Katsutoshi ; Sugiura, Yuta ; Sugimoto, Maki ; Tokuda, Yutaka ; Plasencia, Diego Martinez ; Subramanian, Sriram ; Takahashi, Masafumi ; Taka, Hiroaki ; Hirata, Keiji. / E2-MaskZ : A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors. Proceedings of the Augmented Humans International Conference, AHs 2020. Association for Computing Machinery, 2020. (ACM International Conference Proceeding Series).

@inproceedings{0d2860c942df4e588745270c077c838b,

title = "E2-MaskZ: A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors",

abstract = "The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.",

keywords = "Augmented Face, Communication, Human Agent Interaction",

author = "Akino Umezawa and Yoshinari Takegawa and Katsuhiro Suzuki and Katsutoshi Masai and Yuta Sugiura and Maki Sugimoto and Yutaka Tokuda and Plasencia, {Diego Martinez} and Sriram Subramanian and Masafumi Takahashi and Hiroaki Taka and Keiji Hirata",

note = "Funding Information: This work was supported by JSPS KAKENHI Grant Number JP19H04157. Publisher Copyright: {\textcopyright} 2020 Owner/Author.; 2020 Augmented Humans International Conference, AHs 2020 ; Conference date: 16-03-2020 Through 17-03-2020",

year = "2020",

month = mar,

day = "16",

doi = "10.1145/3384657.3385332",

language = "English",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

booktitle = "Proceedings of the Augmented Humans International Conference, AHs 2020",

}

TY - GEN

T1 - E2-MaskZ

T2 - 2020 Augmented Humans International Conference, AHs 2020

AU - Umezawa, Akino

AU - Takegawa, Yoshinari

AU - Suzuki, Katsuhiro

AU - Masai, Katsutoshi

AU - Sugiura, Yuta

AU - Sugimoto, Maki

AU - Tokuda, Yutaka

AU - Plasencia, Diego Martinez

AU - Subramanian, Sriram

AU - Takahashi, Masafumi

AU - Taka, Hiroaki

AU - Hirata, Keiji

PY - 2020/3/16

Y1 - 2020/3/16

N2 - The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.

AB - The goal of this research is to propose the e2-MaskZ, a mask-type display that changes the user's face to the face of an avatar. The e2-MaskZ is composed of a face-capture mask to recognize the facial expression, and a face-display mask to present the avatar that reflects the recognize expression of the system wearer. 40 photo reflective sensors are laid out across the entire surface of the face-capture mask, and the e2-Mask is made to learn the sensor data for each new facial expression.

KW - Augmented Face

KW - Communication

KW - Human Agent Interaction

UR - http://www.scopus.com/inward/record.url?scp=85123042864&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85123042864&partnerID=8YFLogxK

U2 - 10.1145/3384657.3385332

DO - 10.1145/3384657.3385332

M3 - Conference contribution

AN - SCOPUS:85123042864

T3 - ACM International Conference Proceeding Series

BT - Proceedings of the Augmented Humans International Conference, AHs 2020

PB - Association for Computing Machinery

Y2 - 16 March 2020 through 17 March 2020

ER -

E2-MaskZ: A Mask-type Display with Facial Expression Identification using Embedded Photo Reflective Sensors

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this