Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing

Aman Gupta, Finn L. Strivens, Benjamin Tag, Kai Kunze, Jamie A. Ward

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We tend to synchronize our movements to the person we are talking to during face-to-face conversation. Higher interpersonal synchrony is linked to greater empathy and more effortless interactions. This paper presents a first method and a corresponding dataset to explore synchrony in natural conversation by capturing eye and head movement using commodity smart eyewear. We present a 17 hour dataset, using Electrooculography and inertial sensing, of 42 people in conversation (21 dyads: 10 in Japanese, 10 in English, 1 in Chinese). Initial results on 18 dyads show significant interpersonal synchrony of blink and head nod behaviour during conversation (at frequencies of 0.2 to 0.5 Hz). We also find that people are more likely to synchronise blinks at around 1 Hz when conversing back-to-back than when face-to-face.

Original languageEnglish
Title of host publicationISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers
PublisherAssociation for Computing Machinery
Pages66-71
Number of pages6
ISBN (Electronic)9781450368704
DOIs
Publication statusPublished - 2019 Sep 9
Event23rd International Symposium on Wearable Computers, ISWC 2019 - London, United Kingdom
Duration: 2019 Sep 92019 Sep 13

Publication series

NameProceedings - International Symposium on Wearable Computers, ISWC
ISSN (Print)1550-4816

Conference

Conference23rd International Symposium on Wearable Computers, ISWC 2019
CountryUnited Kingdom
CityLondon
Period19/9/919/9/13

Fingerprint

Electrooculography

Keywords

  • Eye tracking
  • Interpersonal synchrony
  • Wearable sensing

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

Gupta, A., Strivens, F. L., Tag, B., Kunze, K., & Ward, J. A. (2019). Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing. In ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers (pp. 66-71). (Proceedings - International Symposium on Wearable Computers, ISWC). Association for Computing Machinery. https://doi.org/10.1145/3341163.3347736

Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing. / Gupta, Aman; Strivens, Finn L.; Tag, Benjamin; Kunze, Kai; Ward, Jamie A.

ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, 2019. p. 66-71 (Proceedings - International Symposium on Wearable Computers, ISWC).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Gupta, A, Strivens, FL, Tag, B, Kunze, K & Ward, JA 2019, Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing. in ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. Proceedings - International Symposium on Wearable Computers, ISWC, Association for Computing Machinery, pp. 66-71, 23rd International Symposium on Wearable Computers, ISWC 2019, London, United Kingdom, 19/9/9. https://doi.org/10.1145/3341163.3347736
Gupta A, Strivens FL, Tag B, Kunze K, Ward JA. Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing. In ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery. 2019. p. 66-71. (Proceedings - International Symposium on Wearable Computers, ISWC). https://doi.org/10.1145/3341163.3347736
Gupta, Aman ; Strivens, Finn L. ; Tag, Benjamin ; Kunze, Kai ; Ward, Jamie A. / Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing. ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, 2019. pp. 66-71 (Proceedings - International Symposium on Wearable Computers, ISWC).
@inproceedings{4310a6d90f904578ac222acbfeb11602,
title = "Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing",
abstract = "We tend to synchronize our movements to the person we are talking to during face-to-face conversation. Higher interpersonal synchrony is linked to greater empathy and more effortless interactions. This paper presents a first method and a corresponding dataset to explore synchrony in natural conversation by capturing eye and head movement using commodity smart eyewear. We present a 17 hour dataset, using Electrooculography and inertial sensing, of 42 people in conversation (21 dyads: 10 in Japanese, 10 in English, 1 in Chinese). Initial results on 18 dyads show significant interpersonal synchrony of blink and head nod behaviour during conversation (at frequencies of 0.2 to 0.5 Hz). We also find that people are more likely to synchronise blinks at around 1 Hz when conversing back-to-back than when face-to-face.",
keywords = "Eye tracking, Interpersonal synchrony, Wearable sensing",
author = "Aman Gupta and Strivens, {Finn L.} and Benjamin Tag and Kai Kunze and Ward, {Jamie A.}",
year = "2019",
month = "9",
day = "9",
doi = "10.1145/3341163.3347736",
language = "English",
series = "Proceedings - International Symposium on Wearable Computers, ISWC",
publisher = "Association for Computing Machinery",
pages = "66--71",
booktitle = "ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers",

}

TY - GEN

T1 - Blink as you Sync - Uncovering eye and nod synchrony in conversation using wearable sensing

AU - Gupta, Aman

AU - Strivens, Finn L.

AU - Tag, Benjamin

AU - Kunze, Kai

AU - Ward, Jamie A.

PY - 2019/9/9

Y1 - 2019/9/9

N2 - We tend to synchronize our movements to the person we are talking to during face-to-face conversation. Higher interpersonal synchrony is linked to greater empathy and more effortless interactions. This paper presents a first method and a corresponding dataset to explore synchrony in natural conversation by capturing eye and head movement using commodity smart eyewear. We present a 17 hour dataset, using Electrooculography and inertial sensing, of 42 people in conversation (21 dyads: 10 in Japanese, 10 in English, 1 in Chinese). Initial results on 18 dyads show significant interpersonal synchrony of blink and head nod behaviour during conversation (at frequencies of 0.2 to 0.5 Hz). We also find that people are more likely to synchronise blinks at around 1 Hz when conversing back-to-back than when face-to-face.

AB - We tend to synchronize our movements to the person we are talking to during face-to-face conversation. Higher interpersonal synchrony is linked to greater empathy and more effortless interactions. This paper presents a first method and a corresponding dataset to explore synchrony in natural conversation by capturing eye and head movement using commodity smart eyewear. We present a 17 hour dataset, using Electrooculography and inertial sensing, of 42 people in conversation (21 dyads: 10 in Japanese, 10 in English, 1 in Chinese). Initial results on 18 dyads show significant interpersonal synchrony of blink and head nod behaviour during conversation (at frequencies of 0.2 to 0.5 Hz). We also find that people are more likely to synchronise blinks at around 1 Hz when conversing back-to-back than when face-to-face.

KW - Eye tracking

KW - Interpersonal synchrony

KW - Wearable sensing

UR - http://www.scopus.com/inward/record.url?scp=85072808277&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072808277&partnerID=8YFLogxK

U2 - 10.1145/3341163.3347736

DO - 10.1145/3341163.3347736

M3 - Conference contribution

AN - SCOPUS:85072808277

T3 - Proceedings - International Symposium on Wearable Computers, ISWC

SP - 66

EP - 71

BT - ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers

PB - Association for Computing Machinery

ER -