An augmented reality system for teaching sequential tasks to a household robot

Richard Fung, Sunao Hashimoto, Masahiko Inami, Takeo Igarashi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

We present a method of instructing a sequential task to a household robot using a hand-held augmented reality device. The user decomposes a high-level goal such as "prepare a drink" into steps such as delivering a mug under a kettle and pouring hot water into the mug. The user takes a photograph of each step using the device and annotates it with necessary information via touch operation. The resulting sequence of annotated photographs serves as a reference for review and reuse at a later time. We created a working prototype system with various types of robots and appliances.

Original languageEnglish
Title of host publicationProceedings - IEEE International Workshop on Robot and Human Interactive Communication
Pages282-287
Number of pages6
DOIs
Publication statusPublished - 2011
Event20th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2011 - Atlanta, GA, United States
Duration: 2011 Jul 312011 Aug 3

Other

Other20th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2011
CountryUnited States
CityAtlanta, GA
Period11/7/3111/8/3

Fingerprint

Augmented reality
Teaching
Robots
End effectors
Water

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Fung, R., Hashimoto, S., Inami, M., & Igarashi, T. (2011). An augmented reality system for teaching sequential tasks to a household robot. In Proceedings - IEEE International Workshop on Robot and Human Interactive Communication (pp. 282-287). [6005235] https://doi.org/10.1109/ROMAN.2011.6005235

An augmented reality system for teaching sequential tasks to a household robot. / Fung, Richard; Hashimoto, Sunao; Inami, Masahiko; Igarashi, Takeo.

Proceedings - IEEE International Workshop on Robot and Human Interactive Communication. 2011. p. 282-287 6005235.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fung, R, Hashimoto, S, Inami, M & Igarashi, T 2011, An augmented reality system for teaching sequential tasks to a household robot. in Proceedings - IEEE International Workshop on Robot and Human Interactive Communication., 6005235, pp. 282-287, 20th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2011, Atlanta, GA, United States, 11/7/31. https://doi.org/10.1109/ROMAN.2011.6005235
Fung R, Hashimoto S, Inami M, Igarashi T. An augmented reality system for teaching sequential tasks to a household robot. In Proceedings - IEEE International Workshop on Robot and Human Interactive Communication. 2011. p. 282-287. 6005235 https://doi.org/10.1109/ROMAN.2011.6005235
Fung, Richard ; Hashimoto, Sunao ; Inami, Masahiko ; Igarashi, Takeo. / An augmented reality system for teaching sequential tasks to a household robot. Proceedings - IEEE International Workshop on Robot and Human Interactive Communication. 2011. pp. 282-287
@inproceedings{d233d59694294d6bb4a6c9407210de52,
title = "An augmented reality system for teaching sequential tasks to a household robot",
abstract = "We present a method of instructing a sequential task to a household robot using a hand-held augmented reality device. The user decomposes a high-level goal such as {"}prepare a drink{"} into steps such as delivering a mug under a kettle and pouring hot water into the mug. The user takes a photograph of each step using the device and annotates it with necessary information via touch operation. The resulting sequence of annotated photographs serves as a reference for review and reuse at a later time. We created a working prototype system with various types of robots and appliances.",
author = "Richard Fung and Sunao Hashimoto and Masahiko Inami and Takeo Igarashi",
year = "2011",
doi = "10.1109/ROMAN.2011.6005235",
language = "English",
isbn = "9781457715716",
pages = "282--287",
booktitle = "Proceedings - IEEE International Workshop on Robot and Human Interactive Communication",

}

TY - GEN

T1 - An augmented reality system for teaching sequential tasks to a household robot

AU - Fung, Richard

AU - Hashimoto, Sunao

AU - Inami, Masahiko

AU - Igarashi, Takeo

PY - 2011

Y1 - 2011

N2 - We present a method of instructing a sequential task to a household robot using a hand-held augmented reality device. The user decomposes a high-level goal such as "prepare a drink" into steps such as delivering a mug under a kettle and pouring hot water into the mug. The user takes a photograph of each step using the device and annotates it with necessary information via touch operation. The resulting sequence of annotated photographs serves as a reference for review and reuse at a later time. We created a working prototype system with various types of robots and appliances.

AB - We present a method of instructing a sequential task to a household robot using a hand-held augmented reality device. The user decomposes a high-level goal such as "prepare a drink" into steps such as delivering a mug under a kettle and pouring hot water into the mug. The user takes a photograph of each step using the device and annotates it with necessary information via touch operation. The resulting sequence of annotated photographs serves as a reference for review and reuse at a later time. We created a working prototype system with various types of robots and appliances.

UR - http://www.scopus.com/inward/record.url?scp=80053018206&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80053018206&partnerID=8YFLogxK

U2 - 10.1109/ROMAN.2011.6005235

DO - 10.1109/ROMAN.2011.6005235

M3 - Conference contribution

SN - 9781457715716

SP - 282

EP - 287

BT - Proceedings - IEEE International Workshop on Robot and Human Interactive Communication

ER -