Use of an intermediate face between a learner and a teacher in second language learning with shadowing

Yoko Nakanishi; Yasuto Nakanishi

doi:10.1145/2735711.2735828

Use of an intermediate face between a learner and a teacher in second language learning with shadowing

Yoko Nakanishi, Yasuto Nakanishi

Faculty of Environment and Information Studies

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.

Original language	English
Title of host publication	ACM International Conference Proceeding Series
Publisher	Association for Computing Machinery
Pages	113-116
Number of pages	4
Volume	11
ISBN (Print)	9781450333498
DOIs	https://doi.org/10.1145/2735711.2735828
Publication status	Published - 2015 Mar 9
Event	6th Augmented Human International Conference, AH 2015 - Singapore, Singapore Duration: 2015 Mar 9 → 2015 Mar 11

Other

Other	6th Augmented Human International Conference, AH 2015
Country/Territory	Singapore
City	Singapore
Period	15/3/9 → 15/3/11

Keywords

Face tracking
Second language learning
Shadowing

ASJC Scopus subject areas

Human-Computer Interaction
Computer Networks and Communications
Computer Vision and Pattern Recognition
Software

Access to Document

10.1145/2735711.2735828

Cite this

Nakanishi, Y & Nakanishi, Y 2015, Use of an intermediate face between a learner and a teacher in second language learning with shadowing. in ACM International Conference Proceeding Series. vol. 11, Association for Computing Machinery, pp. 113-116, 6th Augmented Human International Conference, AH 2015, Singapore, Singapore, 15/3/9. https://doi.org/10.1145/2735711.2735828

@inproceedings{febebd93d92c495490ce4253d819a43b,

title = "Use of an intermediate face between a learner and a teacher in second language learning with shadowing",

abstract = "Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.",

keywords = "Face tracking, Second language learning, Shadowing",

author = "Yoko Nakanishi and Yasuto Nakanishi",

year = "2015",

month = mar,

day = "9",

doi = "10.1145/2735711.2735828",

language = "English",

isbn = "9781450333498",

volume = "11",

pages = "113--116",

booktitle = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

note = "6th Augmented Human International Conference, AH 2015 ; Conference date: 09-03-2015 Through 11-03-2015",

}

TY - GEN

T1 - Use of an intermediate face between a learner and a teacher in second language learning with shadowing

AU - Nakanishi, Yoko

AU - Nakanishi, Yasuto

PY - 2015/3/9

Y1 - 2015/3/9

N2 - Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.

AB - Shadowing is a language-learning method whereby a learner attempts to repeat, i.e., shadow, what he/she hears immediately. We propose displaying a computer-generated intermediate face between a learner and a teacher as an appropriate intermediate scaffold for shadowing. The intermediate face allows the learner to follow a teacher's face and mouth movements more effectively. We describe a prototype system that generates an intermediate face from real-time camera input and captured video. We also discuss a user study of the prototype system with crowd-sourced participants. The results of the user study suggest that the prototype system provided better pronunciation cues than video-only shadowing techniques.

KW - Face tracking

KW - Second language learning

KW - Shadowing

UR - http://www.scopus.com/inward/record.url?scp=84954158516&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954158516&partnerID=8YFLogxK

U2 - 10.1145/2735711.2735828

DO - 10.1145/2735711.2735828

M3 - Conference contribution

AN - SCOPUS:84954158516

SN - 9781450333498

VL - 11

SP - 113

EP - 116

BT - ACM International Conference Proceeding Series

PB - Association for Computing Machinery

T2 - 6th Augmented Human International Conference, AH 2015

Y2 - 9 March 2015 through 11 March 2015

ER -

Use of an intermediate face between a learner and a teacher in second language learning with shadowing

Abstract

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this