Use of an intermediate face between a learner and a teacher in second language learning with shadowing

Yoko Nakanishi, Yasuto Nakanishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.

Original languageEnglish
Title of host publicationACM International Conference Proceeding Series
PublisherAssociation for Computing Machinery
Pages113-116
Number of pages4
Volume11
ISBN (Print)9781450333498
DOIs
Publication statusPublished - 2015 Mar 9
Event6th Augmented Human International Conference, AH 2015 - Singapore, Singapore
Duration: 2015 Mar 92015 Mar 11

Other

Other6th Augmented Human International Conference, AH 2015
CountrySingapore
CitySingapore
Period15/3/915/3/11

Keywords

  • Face tracking
  • Second language learning
  • Shadowing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'Use of an intermediate face between a learner and a teacher in second language learning with shadowing'. Together they form a unique fingerprint.

  • Cite this

    Nakanishi, Y., & Nakanishi, Y. (2015). Use of an intermediate face between a learner and a teacher in second language learning with shadowing. In ACM International Conference Proceeding Series (Vol. 11, pp. 113-116). Association for Computing Machinery. https://doi.org/10.1145/2735711.2735828