Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development

Kazuki Sakurada, Akari Oka, Ritsuko Kiso, Leina Shimabukuro, Aoba Ueno, Masashi Nakatani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a method to quantify an infant’s exploratory behavior by taking a video of his/her actions and analyzing them. Exploratory behaviors of infants are known to be necessary for the development of cognitive functions and language acquisition. Multiple studies on exploratory behaviors have been conducted; however, exploratory behaviors of infants have been commonly classified and quantified manually, requiring ample efforts. Advances in computer vision research using machine learning in recent years have made it possible to automatically analyze captured videos and register movements of the human body. In this study, we developed a measurement system that enables the quantification of exploratory behaviors of infants by combining OpenPose, OpenFace, and a computer vision library. First, we created a video-capturing environment suitable for capturing an infant’s behavior. Second, we integrated the computer vision library to analyze infants fixating on and touching objects placed in front of them. As a result, we are now able to quantify some aspects of infants’ exploratory behavior. Our measurement system will be useful for investigating the exploratory behavior of six to fifteen-month old children using visual-haptic modalities, and also it will also be valuable in comprehending the developmental stages of each child.

Original languageEnglish
Title of host publicationHaptic Interaction - Perception, Devices and Algorithms, 2018
EditorsHiroyuki Kajimoto, Masashi Konyo, Ki-Uk Kyung, Sang-Youn Kim, Dongjun Lee
PublisherSpringer Verlag
Pages241-246
Number of pages6
ISBN (Print)9789811331930
DOIs
Publication statusPublished - 2019 Jan 1
Event3rd International AsiaHaptics Conference, 2018 - Incheon, Korea, Republic of
Duration: 2018 Nov 142018 Nov 16

Publication series

NameLecture Notes in Electrical Engineering
Volume535
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference3rd International AsiaHaptics Conference, 2018
CountryKorea, Republic of
CityIncheon
Period18/11/1418/11/16

    Fingerprint

Keywords

  • Child psychology
  • Exploratory procedures
  • OpenFace
  • OpenPose

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Cite this

Sakurada, K., Oka, A., Kiso, R., Shimabukuro, L., Ueno, A., & Nakatani, M. (2019). Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development. In H. Kajimoto, M. Konyo, K-U. Kyung, S-Y. Kim, & D. Lee (Eds.), Haptic Interaction - Perception, Devices and Algorithms, 2018 (pp. 241-246). (Lecture Notes in Electrical Engineering; Vol. 535). Springer Verlag. https://doi.org/10.1007/978-981-13-3194-7_55