Model-driven Gaze simulation for the blind person in face-to-face communication

Shi Qiu; Siti Aisyah Binti Anas; Hirotaka Osawa; Matthias Rauterberg; Jun Hu

doi:10.1145/2974804.2980482

Model-driven Gaze simulation for the blind person in face-to-face communication

Shi Qiu, Siti Aisyah Binti Anas, Hirotaka Osawa, Matthias Rauterberg, Jun Hu

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

In face-to-face communication, eye gaze is integral to a conversation to supplement verbal language. The sighted often uses eye gaze to convey nonverbal information in social interactions, which a blind conversation partner cannot access and react to them. In this paper, we present E-Gaze glasses (E-Gaze), an assistive device based on an eye tracking system. It simulates gaze for the blind person to react and engage the sighted in face-to-face conversations. It is designed based on a model that combines eye-contact mechanism and turn-taking strategy. We further propose an experimental design to test the E-Gaze and hypothesize that the model-driven gaze simulation can enhance the conversation quality between the sighted and the blind person in face-to-face communication.

Original language	English
Title of host publication	HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction
Publisher	Association for Computing Machinery, Inc
Pages	59-62
Number of pages	4
ISBN (Electronic)	9781450345088
DOIs	https://doi.org/10.1145/2974804.2980482
Publication status	Published - 2016 Oct 4
Externally published	Yes
Event	4th International Conference on Human Agent Interaction, HAI 2016 - Biopolis, Singapore Duration: 2016 Oct 4 → 2016 Oct 7

Publication series

Name	HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction

Other

Other	4th International Conference on Human Agent Interaction, HAI 2016
Country/Territory	Singapore
City	Biopolis
Period	16/10/4 → 16/10/7

Keywords

Conversation quality
Eye contact
Eye tracking

ASJC Scopus subject areas

Human-Computer Interaction

Access to Document

10.1145/2974804.2980482

Cite this

Qiu, S., Anas, S. A. B., Osawa, H., Rauterberg, M., & Hu, J. (2016). Model-driven Gaze simulation for the blind person in face-to-face communication. In HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction (pp. 59-62). (HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction). Association for Computing Machinery, Inc. https://doi.org/10.1145/2974804.2980482

Model-driven Gaze simulation for the blind person in face-to-face communication. / Qiu, Shi; Anas, Siti Aisyah Binti; Osawa, Hirotaka et al.

HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction. Association for Computing Machinery, Inc, 2016. p. 59-62 (HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Qiu, S, Anas, SAB, Osawa, H, Rauterberg, M & Hu, J 2016, Model-driven Gaze simulation for the blind person in face-to-face communication. in HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction. HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction, Association for Computing Machinery, Inc, pp. 59-62, 4th International Conference on Human Agent Interaction, HAI 2016, Biopolis, Singapore, 16/10/4. https://doi.org/10.1145/2974804.2980482

Qiu S, Anas SAB, Osawa H, Rauterberg M, Hu J. Model-driven Gaze simulation for the blind person in face-to-face communication. In HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction. Association for Computing Machinery, Inc. 2016. p. 59-62. (HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction). doi: 10.1145/2974804.2980482

Qiu, Shi ; Anas, Siti Aisyah Binti ; Osawa, Hirotaka et al. / Model-driven Gaze simulation for the blind person in face-to-face communication. HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction. Association for Computing Machinery, Inc, 2016. pp. 59-62 (HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction).

@inproceedings{f901af0c893941f4ab05d1055ad6e38a,

title = "Model-driven Gaze simulation for the blind person in face-to-face communication",

abstract = "In face-to-face communication, eye gaze is integral to a conversation to supplement verbal language. The sighted often uses eye gaze to convey nonverbal information in social interactions, which a blind conversation partner cannot access and react to them. In this paper, we present E-Gaze glasses (E-Gaze), an assistive device based on an eye tracking system. It simulates gaze for the blind person to react and engage the sighted in face-to-face conversations. It is designed based on a model that combines eye-contact mechanism and turn-taking strategy. We further propose an experimental design to test the E-Gaze and hypothesize that the model-driven gaze simulation can enhance the conversation quality between the sighted and the blind person in face-to-face communication.",

keywords = "Conversation quality, Eye contact, Eye tracking",

author = "Shi Qiu and Anas, {Siti Aisyah Binti} and Hirotaka Osawa and Matthias Rauterberg and Jun Hu",

note = "Publisher Copyright: Copyright {\textcopyright} 2016 ACM.; 4th International Conference on Human Agent Interaction, HAI 2016 ; Conference date: 04-10-2016 Through 07-10-2016",

year = "2016",

month = oct,

day = "4",

doi = "10.1145/2974804.2980482",

language = "English",

series = "HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction",

publisher = "Association for Computing Machinery, Inc",

pages = "59--62",

booktitle = "HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction",

}

TY - GEN

T1 - Model-driven Gaze simulation for the blind person in face-to-face communication

AU - Qiu, Shi

AU - Anas, Siti Aisyah Binti

AU - Osawa, Hirotaka

AU - Rauterberg, Matthias

AU - Hu, Jun

PY - 2016/10/4

Y1 - 2016/10/4

N2 - In face-to-face communication, eye gaze is integral to a conversation to supplement verbal language. The sighted often uses eye gaze to convey nonverbal information in social interactions, which a blind conversation partner cannot access and react to them. In this paper, we present E-Gaze glasses (E-Gaze), an assistive device based on an eye tracking system. It simulates gaze for the blind person to react and engage the sighted in face-to-face conversations. It is designed based on a model that combines eye-contact mechanism and turn-taking strategy. We further propose an experimental design to test the E-Gaze and hypothesize that the model-driven gaze simulation can enhance the conversation quality between the sighted and the blind person in face-to-face communication.

AB - In face-to-face communication, eye gaze is integral to a conversation to supplement verbal language. The sighted often uses eye gaze to convey nonverbal information in social interactions, which a blind conversation partner cannot access and react to them. In this paper, we present E-Gaze glasses (E-Gaze), an assistive device based on an eye tracking system. It simulates gaze for the blind person to react and engage the sighted in face-to-face conversations. It is designed based on a model that combines eye-contact mechanism and turn-taking strategy. We further propose an experimental design to test the E-Gaze and hypothesize that the model-driven gaze simulation can enhance the conversation quality between the sighted and the blind person in face-to-face communication.

KW - Conversation quality

KW - Eye contact

KW - Eye tracking

UR - http://www.scopus.com/inward/record.url?scp=84994479833&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84994479833&partnerID=8YFLogxK

U2 - 10.1145/2974804.2980482

DO - 10.1145/2974804.2980482

M3 - Conference contribution

AN - SCOPUS:84994479833

T3 - HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction

SP - 59

EP - 62

BT - HAI 2016 - Proceedings of the 4th International Conference on Human Agent Interaction

PB - Association for Computing Machinery, Inc

T2 - 4th International Conference on Human Agent Interaction, HAI 2016

Y2 - 4 October 2016 through 7 October 2016

ER -

Model-driven Gaze simulation for the blind person in face-to-face communication

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this