An augmented reality system for teaching sequential tasks to a household robot

Richard Fung, Sunao Hashimoto, Masahiko Inami, Takeo Igarashi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

We present a method of instructing a sequential task to a household robot using a hand-held augmented reality device. The user decomposes a high-level goal such as "prepare a drink" into steps such as delivering a mug under a kettle and pouring hot water into the mug. The user takes a photograph of each step using the device and annotates it with necessary information via touch operation. The resulting sequence of annotated photographs serves as a reference for review and reuse at a later time. We created a working prototype system with various types of robots and appliances.

Original languageEnglish
Title of host publication2011 RO-MAN - 20th IEEE International Symposium on Robot and Human Interactive Communication, Symposium Digest
Pages282-287
Number of pages6
DOIs
Publication statusPublished - 2011 Sep 26
Event20th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2011 - Atlanta, GA, United States
Duration: 2011 Jul 312011 Aug 3

Publication series

NameProceedings - IEEE International Workshop on Robot and Human Interactive Communication

Other

Other20th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2011
CountryUnited States
CityAtlanta, GA
Period11/7/3111/8/3

    Fingerprint

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Fung, R., Hashimoto, S., Inami, M., & Igarashi, T. (2011). An augmented reality system for teaching sequential tasks to a household robot. In 2011 RO-MAN - 20th IEEE International Symposium on Robot and Human Interactive Communication, Symposium Digest (pp. 282-287). [6005235] (Proceedings - IEEE International Workshop on Robot and Human Interactive Communication). https://doi.org/10.1109/ROMAN.2011.6005235