Use of an intermediate face between a learner and a teacher in second language learning with shadowing

Yoko Nakanishi, Yasuto Nakanishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.

Original languageEnglish
Title of host publicationACM International Conference Proceeding Series
PublisherAssociation for Computing Machinery
Pages113-116
Number of pages4
Volume11
ISBN (Print)9781450333498
DOIs
Publication statusPublished - 2015 Mar 9
Event6th Augmented Human International Conference, AH 2015 - Singapore, Singapore
Duration: 2015 Mar 92015 Mar 11

Other

Other6th Augmented Human International Conference, AH 2015
CountrySingapore
CitySingapore
Period15/3/915/3/11

Fingerprint

Scaffolds
Cameras

Keywords

  • Face tracking
  • Second language learning
  • Shadowing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Nakanishi, Y., & Nakanishi, Y. (2015). Use of an intermediate face between a learner and a teacher in second language learning with shadowing. In ACM International Conference Proceeding Series (Vol. 11, pp. 113-116). Association for Computing Machinery. https://doi.org/10.1145/2735711.2735828

Use of an intermediate face between a learner and a teacher in second language learning with shadowing. / Nakanishi, Yoko; Nakanishi, Yasuto.

ACM International Conference Proceeding Series. Vol. 11 Association for Computing Machinery, 2015. p. 113-116.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nakanishi, Y & Nakanishi, Y 2015, Use of an intermediate face between a learner and a teacher in second language learning with shadowing. in ACM International Conference Proceeding Series. vol. 11, Association for Computing Machinery, pp. 113-116, 6th Augmented Human International Conference, AH 2015, Singapore, Singapore, 15/3/9. https://doi.org/10.1145/2735711.2735828
Nakanishi Y, Nakanishi Y. Use of an intermediate face between a learner and a teacher in second language learning with shadowing. In ACM International Conference Proceeding Series. Vol. 11. Association for Computing Machinery. 2015. p. 113-116 https://doi.org/10.1145/2735711.2735828
Nakanishi, Yoko ; Nakanishi, Yasuto. / Use of an intermediate face between a learner and a teacher in second language learning with shadowing. ACM International Conference Proceeding Series. Vol. 11 Association for Computing Machinery, 2015. pp. 113-116
@inproceedings{febebd93d92c495490ce4253d819a43b,
title = "Use of an intermediate face between a learner and a teacher in second language learning with shadowing",
abstract = "Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.",
keywords = "Face tracking, Second language learning, Shadowing",
author = "Yoko Nakanishi and Yasuto Nakanishi",
year = "2015",
month = "3",
day = "9",
doi = "10.1145/2735711.2735828",
language = "English",
isbn = "9781450333498",
volume = "11",
pages = "113--116",
booktitle = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Use of an intermediate face between a learner and a teacher in second language learning with shadowing

AU - Nakanishi, Yoko

AU - Nakanishi, Yasuto

PY - 2015/3/9

Y1 - 2015/3/9

N2 - Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.

AB - Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.

KW - Face tracking

KW - Second language learning

KW - Shadowing

UR - http://www.scopus.com/inward/record.url?scp=84954158516&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954158516&partnerID=8YFLogxK

U2 - 10.1145/2735711.2735828

DO - 10.1145/2735711.2735828

M3 - Conference contribution

AN - SCOPUS:84954158516

SN - 9781450333498

VL - 11

SP - 113

EP - 116

BT - ACM International Conference Proceeding Series

PB - Association for Computing Machinery

ER -