Sound symbolism scaffolds language development in preverbal infants

Michiko Asano, Mutsumi Imai, Sotaro Kita, Keiichi Kitajo, Hiroyuki Okada, Guillaume Thierry

Research output: Contribution to journalArticle

49 Citations (Scopus)

Abstract

A fundamental question in language development is how infants start to assign meaning to words. Here, using three Electroencephalogram (EEG)-based measures of brain activity, we establish that preverbal 11-month-old infants are sensitive to the non-arbitrary correspondences between language sounds and concepts, that is, to sound symbolism. In each trial, infant participants were presented with a visual stimulus (e.g., a round shape) followed by a novel spoken word that either sound-symbolically matched ("moma") or mismatched ("kipi") the shape. Amplitude increase in the gamma band showed perceptual integration of visual and auditory stimuli in the match condition within 300msec of word onset. Furthermore, phase synchronization between electrodes at around 400msec revealed intensified large-scale, left-hemispheric communication between brain regions in the mismatch condition as compared to the match condition, indicating heightened processing effort when integration was more demanding. Finally, event-related brain potentials showed an increased adult-like N400 response - an index of semantic integration difficulty - in the mismatch as compared to the match condition. Together, these findings suggest that 11-month-old infants spontaneously map auditory language onto visual experience by recruiting a cross-modal perceptual processing system and a nascent semantic network within the first year of life.

Original languageEnglish
Pages (from-to)196-205
Number of pages10
JournalCortex
Volume63
DOIs
Publication statusPublished - 2014 Sep 16

Fingerprint

Language Development
Semantics
Brain
Language
Evoked Potentials
Electroencephalography
Electrodes
Communication
Symbolism
Sound Symbolism
Mismatch
Visual Stimuli
Sound

Keywords

  • Amplitude change analysis of EEG
  • Audio-visual correspondences
  • Language development
  • Phase synchronization analysis of EEG
  • Sound symbolism

ASJC Scopus subject areas

  • Clinical Neurology
  • Neurology
  • Arts and Humanities (miscellaneous)
  • Developmental and Educational Psychology

Cite this

Sound symbolism scaffolds language development in preverbal infants. / Asano, Michiko; Imai, Mutsumi; Kita, Sotaro; Kitajo, Keiichi; Okada, Hiroyuki; Thierry, Guillaume.

In: Cortex, Vol. 63, 16.09.2014, p. 196-205.

Research output: Contribution to journalArticle

Asano, M, Imai, M, Kita, S, Kitajo, K, Okada, H & Thierry, G 2014, 'Sound symbolism scaffolds language development in preverbal infants', Cortex, vol. 63, pp. 196-205. https://doi.org/10.1016/j.cortex.2014.08.025
Asano, Michiko ; Imai, Mutsumi ; Kita, Sotaro ; Kitajo, Keiichi ; Okada, Hiroyuki ; Thierry, Guillaume. / Sound symbolism scaffolds language development in preverbal infants. In: Cortex. 2014 ; Vol. 63. pp. 196-205.
@article{ca2de6c4f3e84f69b6b6bb72933928df,
title = "Sound symbolism scaffolds language development in preverbal infants",
abstract = "A fundamental question in language development is how infants start to assign meaning to words. Here, using three Electroencephalogram (EEG)-based measures of brain activity, we establish that preverbal 11-month-old infants are sensitive to the non-arbitrary correspondences between language sounds and concepts, that is, to sound symbolism. In each trial, infant participants were presented with a visual stimulus (e.g., a round shape) followed by a novel spoken word that either sound-symbolically matched ({"}moma{"}) or mismatched ({"}kipi{"}) the shape. Amplitude increase in the gamma band showed perceptual integration of visual and auditory stimuli in the match condition within 300msec of word onset. Furthermore, phase synchronization between electrodes at around 400msec revealed intensified large-scale, left-hemispheric communication between brain regions in the mismatch condition as compared to the match condition, indicating heightened processing effort when integration was more demanding. Finally, event-related brain potentials showed an increased adult-like N400 response - an index of semantic integration difficulty - in the mismatch as compared to the match condition. Together, these findings suggest that 11-month-old infants spontaneously map auditory language onto visual experience by recruiting a cross-modal perceptual processing system and a nascent semantic network within the first year of life.",
keywords = "Amplitude change analysis of EEG, Audio-visual correspondences, Language development, Phase synchronization analysis of EEG, Sound symbolism",
author = "Michiko Asano and Mutsumi Imai and Sotaro Kita and Keiichi Kitajo and Hiroyuki Okada and Guillaume Thierry",
year = "2014",
month = "9",
day = "16",
doi = "10.1016/j.cortex.2014.08.025",
language = "English",
volume = "63",
pages = "196--205",
journal = "Cortex",
issn = "0010-9452",
publisher = "Masson SpA",

}

TY - JOUR

T1 - Sound symbolism scaffolds language development in preverbal infants

AU - Asano, Michiko

AU - Imai, Mutsumi

AU - Kita, Sotaro

AU - Kitajo, Keiichi

AU - Okada, Hiroyuki

AU - Thierry, Guillaume

PY - 2014/9/16

Y1 - 2014/9/16

N2 - A fundamental question in language development is how infants start to assign meaning to words. Here, using three Electroencephalogram (EEG)-based measures of brain activity, we establish that preverbal 11-month-old infants are sensitive to the non-arbitrary correspondences between language sounds and concepts, that is, to sound symbolism. In each trial, infant participants were presented with a visual stimulus (e.g., a round shape) followed by a novel spoken word that either sound-symbolically matched ("moma") or mismatched ("kipi") the shape. Amplitude increase in the gamma band showed perceptual integration of visual and auditory stimuli in the match condition within 300msec of word onset. Furthermore, phase synchronization between electrodes at around 400msec revealed intensified large-scale, left-hemispheric communication between brain regions in the mismatch condition as compared to the match condition, indicating heightened processing effort when integration was more demanding. Finally, event-related brain potentials showed an increased adult-like N400 response - an index of semantic integration difficulty - in the mismatch as compared to the match condition. Together, these findings suggest that 11-month-old infants spontaneously map auditory language onto visual experience by recruiting a cross-modal perceptual processing system and a nascent semantic network within the first year of life.

AB - A fundamental question in language development is how infants start to assign meaning to words. Here, using three Electroencephalogram (EEG)-based measures of brain activity, we establish that preverbal 11-month-old infants are sensitive to the non-arbitrary correspondences between language sounds and concepts, that is, to sound symbolism. In each trial, infant participants were presented with a visual stimulus (e.g., a round shape) followed by a novel spoken word that either sound-symbolically matched ("moma") or mismatched ("kipi") the shape. Amplitude increase in the gamma band showed perceptual integration of visual and auditory stimuli in the match condition within 300msec of word onset. Furthermore, phase synchronization between electrodes at around 400msec revealed intensified large-scale, left-hemispheric communication between brain regions in the mismatch condition as compared to the match condition, indicating heightened processing effort when integration was more demanding. Finally, event-related brain potentials showed an increased adult-like N400 response - an index of semantic integration difficulty - in the mismatch as compared to the match condition. Together, these findings suggest that 11-month-old infants spontaneously map auditory language onto visual experience by recruiting a cross-modal perceptual processing system and a nascent semantic network within the first year of life.

KW - Amplitude change analysis of EEG

KW - Audio-visual correspondences

KW - Language development

KW - Phase synchronization analysis of EEG

KW - Sound symbolism

UR - http://www.scopus.com/inward/record.url?scp=84907774228&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84907774228&partnerID=8YFLogxK

U2 - 10.1016/j.cortex.2014.08.025

DO - 10.1016/j.cortex.2014.08.025

M3 - Article

VL - 63

SP - 196

EP - 205

JO - Cortex

JF - Cortex

SN - 0010-9452

ER -