Visualizing gaze direction to support video coding of social attention for children with autism spectrum disorder

Keita Higuch, Soichiro Matsuda, Rie Kamikubo, Takuya Enomoto, Yusuke Sugano, Junichi Yamamoto, Yoichi Sato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

This paper presents a novel interface to support video coding of social attention in the assessment of children with autism spectrum disorder. Video-based evaluations of social attention during therapeutic activities allow observers to find target behaviors while handling the ambiguity of attention. Despite the recent advances in computer vision-based gaze estimation methods, fully automatic recognition of social attention under diverse environments is still challenging. The goal of this work is to investigate an approach that uses automatic video analysis in a supportive manner for guiding human judgment. The proposed interface displays visualization of gaze estimation results on videos and provides GUI support to allow users to facilitate agreement between observers by defining social attention labels on the video timeline. Through user studies and expert reviews, we show how the interface helps observers perform video coding of social attention and how human judgment compensates for technical limitations of the automatic gaze analysis.

Original languageEnglish
Title of host publicationIUI 2018 - Proceedings of the 23rd International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
Pages571-582
Number of pages12
ISBN (Electronic)9781450349451
DOIs
Publication statusPublished - 2018 Mar 5
Event23rd ACM International Conference on Intelligent User Interfaces, IUI 2018 - Tokyo, Japan
Duration: 2018 Mar 72018 Mar 11

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI

Conference

Conference23rd ACM International Conference on Intelligent User Interfaces, IUI 2018
Country/TerritoryJapan
CityTokyo
Period18/3/718/3/11

Keywords

  • Children with ASD
  • Social attention
  • Video coding support

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Visualizing gaze direction to support video coding of social attention for children with autism spectrum disorder'. Together they form a unique fingerprint.

Cite this