Baby Touch

Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development

Kazuki Sakurada, Akari Oka, Ritsuko Kiso, Leina Shimabukuro, Aoba Ueno, Masashi Nakatani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a method to quantify an infant’s exploratory behavior by taking a video of his/her actions and analyzing them. Exploratory behaviors of infants are known to be necessary for the development of cognitive functions and language acquisition. Multiple studies on exploratory behaviors have been conducted; however, exploratory behaviors of infants have been commonly classified and quantified manually, requiring ample efforts. Advances in computer vision research using machine learning in recent years have made it possible to automatically analyze captured videos and register movements of the human body. In this study, we developed a measurement system that enables the quantification of exploratory behaviors of infants by combining OpenPose, OpenFace, and a computer vision library. First, we created a video-capturing environment suitable for capturing an infant’s behavior. Second, we integrated the computer vision library to analyze infants fixating on and touching objects placed in front of them. As a result, we are now able to quantify some aspects of infants’ exploratory behavior. Our measurement system will be useful for investigating the exploratory behavior of six to fifteen-month old children using visual-haptic modalities, and also it will also be valuable in comprehending the developmental stages of each child.

Original languageEnglish
Title of host publicationHaptic Interaction - Perception, Devices and Algorithms, 2018
EditorsHiroyuki Kajimoto, Masashi Konyo, Ki-Uk Kyung, Sang-Youn Kim, Dongjun Lee
PublisherSpringer Verlag
Pages241-246
Number of pages6
ISBN (Print)9789811331930
DOIs
Publication statusPublished - 2019 Jan 1
Event3rd International AsiaHaptics Conference, 2018 - Incheon, Korea, Republic of
Duration: 2018 Nov 142018 Nov 16

Publication series

NameLecture Notes in Electrical Engineering
Volume535
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference3rd International AsiaHaptics Conference, 2018
CountryKorea, Republic of
CityIncheon
Period18/11/1418/11/16

Fingerprint

Computer vision
Learning systems

Keywords

  • Child psychology
  • Exploratory procedures
  • OpenFace
  • OpenPose

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering

Cite this

Sakurada, K., Oka, A., Kiso, R., Shimabukuro, L., Ueno, A., & Nakatani, M. (2019). Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development. In H. Kajimoto, M. Konyo, K-U. Kyung, S-Y. Kim, & D. Lee (Eds.), Haptic Interaction - Perception, Devices and Algorithms, 2018 (pp. 241-246). (Lecture Notes in Electrical Engineering; Vol. 535). Springer Verlag. https://doi.org/10.1007/978-981-13-3194-7_55

Baby Touch : Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development. / Sakurada, Kazuki; Oka, Akari; Kiso, Ritsuko; Shimabukuro, Leina; Ueno, Aoba; Nakatani, Masashi.

Haptic Interaction - Perception, Devices and Algorithms, 2018. ed. / Hiroyuki Kajimoto; Masashi Konyo; Ki-Uk Kyung; Sang-Youn Kim; Dongjun Lee. Springer Verlag, 2019. p. 241-246 (Lecture Notes in Electrical Engineering; Vol. 535).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sakurada, K, Oka, A, Kiso, R, Shimabukuro, L, Ueno, A & Nakatani, M 2019, Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development. in H Kajimoto, M Konyo, K-U Kyung, S-Y Kim & D Lee (eds), Haptic Interaction - Perception, Devices and Algorithms, 2018. Lecture Notes in Electrical Engineering, vol. 535, Springer Verlag, pp. 241-246, 3rd International AsiaHaptics Conference, 2018, Incheon, Korea, Republic of, 18/11/14. https://doi.org/10.1007/978-981-13-3194-7_55
Sakurada K, Oka A, Kiso R, Shimabukuro L, Ueno A, Nakatani M. Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development. In Kajimoto H, Konyo M, Kyung K-U, Kim S-Y, Lee D, editors, Haptic Interaction - Perception, Devices and Algorithms, 2018. Springer Verlag. 2019. p. 241-246. (Lecture Notes in Electrical Engineering). https://doi.org/10.1007/978-981-13-3194-7_55
Sakurada, Kazuki ; Oka, Akari ; Kiso, Ritsuko ; Shimabukuro, Leina ; Ueno, Aoba ; Nakatani, Masashi. / Baby Touch : Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development. Haptic Interaction - Perception, Devices and Algorithms, 2018. editor / Hiroyuki Kajimoto ; Masashi Konyo ; Ki-Uk Kyung ; Sang-Youn Kim ; Dongjun Lee. Springer Verlag, 2019. pp. 241-246 (Lecture Notes in Electrical Engineering).
@inproceedings{d765a698a7ff44d8830d701801178677,
title = "Baby Touch: Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development",
abstract = "We propose a method to quantify an infant’s exploratory behavior by taking a video of his/her actions and analyzing them. Exploratory behaviors of infants are known to be necessary for the development of cognitive functions and language acquisition. Multiple studies on exploratory behaviors have been conducted; however, exploratory behaviors of infants have been commonly classified and quantified manually, requiring ample efforts. Advances in computer vision research using machine learning in recent years have made it possible to automatically analyze captured videos and register movements of the human body. In this study, we developed a measurement system that enables the quantification of exploratory behaviors of infants by combining OpenPose, OpenFace, and a computer vision library. First, we created a video-capturing environment suitable for capturing an infant’s behavior. Second, we integrated the computer vision library to analyze infants fixating on and touching objects placed in front of them. As a result, we are now able to quantify some aspects of infants’ exploratory behavior. Our measurement system will be useful for investigating the exploratory behavior of six to fifteen-month old children using visual-haptic modalities, and also it will also be valuable in comprehending the developmental stages of each child.",
keywords = "Child psychology, Exploratory procedures, OpenFace, OpenPose",
author = "Kazuki Sakurada and Akari Oka and Ritsuko Kiso and Leina Shimabukuro and Aoba Ueno and Masashi Nakatani",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-981-13-3194-7_55",
language = "English",
isbn = "9789811331930",
series = "Lecture Notes in Electrical Engineering",
publisher = "Springer Verlag",
pages = "241--246",
editor = "Hiroyuki Kajimoto and Masashi Konyo and Ki-Uk Kyung and Sang-Youn Kim and Dongjun Lee",
booktitle = "Haptic Interaction - Perception, Devices and Algorithms, 2018",
address = "Germany",

}

TY - GEN

T1 - Baby Touch

T2 - Quantifying Visual-Haptic Exploratory Behaviors in Infants of Sensory-Motor Development

AU - Sakurada, Kazuki

AU - Oka, Akari

AU - Kiso, Ritsuko

AU - Shimabukuro, Leina

AU - Ueno, Aoba

AU - Nakatani, Masashi

PY - 2019/1/1

Y1 - 2019/1/1

N2 - We propose a method to quantify an infant’s exploratory behavior by taking a video of his/her actions and analyzing them. Exploratory behaviors of infants are known to be necessary for the development of cognitive functions and language acquisition. Multiple studies on exploratory behaviors have been conducted; however, exploratory behaviors of infants have been commonly classified and quantified manually, requiring ample efforts. Advances in computer vision research using machine learning in recent years have made it possible to automatically analyze captured videos and register movements of the human body. In this study, we developed a measurement system that enables the quantification of exploratory behaviors of infants by combining OpenPose, OpenFace, and a computer vision library. First, we created a video-capturing environment suitable for capturing an infant’s behavior. Second, we integrated the computer vision library to analyze infants fixating on and touching objects placed in front of them. As a result, we are now able to quantify some aspects of infants’ exploratory behavior. Our measurement system will be useful for investigating the exploratory behavior of six to fifteen-month old children using visual-haptic modalities, and also it will also be valuable in comprehending the developmental stages of each child.

AB - We propose a method to quantify an infant’s exploratory behavior by taking a video of his/her actions and analyzing them. Exploratory behaviors of infants are known to be necessary for the development of cognitive functions and language acquisition. Multiple studies on exploratory behaviors have been conducted; however, exploratory behaviors of infants have been commonly classified and quantified manually, requiring ample efforts. Advances in computer vision research using machine learning in recent years have made it possible to automatically analyze captured videos and register movements of the human body. In this study, we developed a measurement system that enables the quantification of exploratory behaviors of infants by combining OpenPose, OpenFace, and a computer vision library. First, we created a video-capturing environment suitable for capturing an infant’s behavior. Second, we integrated the computer vision library to analyze infants fixating on and touching objects placed in front of them. As a result, we are now able to quantify some aspects of infants’ exploratory behavior. Our measurement system will be useful for investigating the exploratory behavior of six to fifteen-month old children using visual-haptic modalities, and also it will also be valuable in comprehending the developmental stages of each child.

KW - Child psychology

KW - Exploratory procedures

KW - OpenFace

KW - OpenPose

UR - http://www.scopus.com/inward/record.url?scp=85065995893&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065995893&partnerID=8YFLogxK

U2 - 10.1007/978-981-13-3194-7_55

DO - 10.1007/978-981-13-3194-7_55

M3 - Conference contribution

SN - 9789811331930

T3 - Lecture Notes in Electrical Engineering

SP - 241

EP - 246

BT - Haptic Interaction - Perception, Devices and Algorithms, 2018

A2 - Kajimoto, Hiroyuki

A2 - Konyo, Masashi

A2 - Kyung, Ki-Uk

A2 - Kim, Sang-Youn

A2 - Lee, Dongjun

PB - Springer Verlag

ER -