Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development

Kazuki Sakurada, Akari Oka, Ritsuko Kiso, Leina Shimabukuro, Aoba Ueno, Masashi Nakatani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


We propose a method to quantify an infant’s exploratory behavior by taking a video of his/her actions and analyzing them. Exploratory behaviors of infants are known to be necessary for the development of cognitive functions and language acquisition. Multiple studies on exploratory behaviors have been conducted; however, exploratory behaviors of infants have been commonly classified and quantified manually, requiring ample efforts. Advances in computer vision research using machine learning in recent years have made it possible to automatically analyze captured videos and register movements of the human body. In this study, we developed a measurement system that enables the quantification of exploratory behaviors of infants by combining OpenPose, OpenFace, and a computer vision library. First, we created a video-capturing environment suitable for capturing an infant’s behavior. Second, we integrated the computer vision library to analyze infants fixating on and touching objects placed in front of them. As a result, we are now able to quantify some aspects of infants’ exploratory behavior. Our measurement system will be useful for investigating the exploratory behavior of six to fifteen-month old children using visual-haptic modalities, and also it will also be valuable in comprehending the developmental stages of each child.

Original languageEnglish
Title of host publicationHaptic Interaction - Perception, Devices and Algorithms, 2018
EditorsHiroyuki Kajimoto, Ki-Uk Kyung, Masashi Konyo, Sang-Youn Kim, Dongjun Lee
PublisherSpringer Verlag
Number of pages6
ISBN (Print)9789811331930
Publication statusPublished - 2019
Event3rd International AsiaHaptics Conference, 2018 - Incheon, Korea, Republic of
Duration: 2018 Nov 142018 Nov 16

Publication series

NameLecture Notes in Electrical Engineering
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119


Conference3rd International AsiaHaptics Conference, 2018
Country/TerritoryKorea, Republic of


  • Child psychology
  • Exploratory procedures
  • OpenFace
  • OpenPose

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering


Dive into the research topics of 'Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development'. Together they form a unique fingerprint.

Cite this