Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model

Osamu Sugiyama, Takayuki Kanda, Michita Imai, Hiroshi Ishiguro, Norihiro Hagita, Yuichiro Anzai

Research output: Contribution to journalArticle

54 Citations (Scopus)

Abstract

When describing a physical object, we indicate which object by pointing and using reference terms, such as 'this' and 'that', to inform the listener quickly of an indicated object's location. Therefore, this research proposes using a three-layer attention-drawing model for humanoid robots that incorporates such gestures and verbal cues. The proposed three-layer model consists of three sub-models: the Reference Term Model (RTM); the Limit Distance Model (LDM); and the Object Property Model (OPM). The RTM selects an appropriate reference term for distance, based on a quantitative analysis of human behaviour. The LDM decides whether to use a property of the object, such as colour, as an additional term for distinguishing the object from its neighbours. The OPM determines which property should be used for this additional reference. Based on this concept, an attention-drawing system was developed for a communication robot named 'Robovie', and its effectiveness was tested.

Original languageEnglish
Pages (from-to)379-402
Number of pages24
JournalConnection Science
Volume18
Issue number4
DOIs
Publication statusPublished - 2006 Dec 1
Externally publishedYes

Fingerprint

Gesture
Term
Model
Robots
Drawing
Humanoid Robot
Human Behavior
Object
Quantitative Analysis
Robot
Color
Communication
Chemical analysis

Keywords

  • Deictic gestures
  • Human-robot interaction
  • Human-robot interface

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Artificial Intelligence
  • Theoretical Computer Science
  • Computational Theory and Mathematics

Cite this

Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model. / Sugiyama, Osamu; Kanda, Takayuki; Imai, Michita; Ishiguro, Hiroshi; Hagita, Norihiro; Anzai, Yuichiro.

In: Connection Science, Vol. 18, No. 4, 01.12.2006, p. 379-402.

Research output: Contribution to journalArticle

Sugiyama, Osamu ; Kanda, Takayuki ; Imai, Michita ; Ishiguro, Hiroshi ; Hagita, Norihiro ; Anzai, Yuichiro. / Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model. In: Connection Science. 2006 ; Vol. 18, No. 4. pp. 379-402.
@article{fc20f1adabd6484b8322bcb91b7f1561,
title = "Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model",
abstract = "When describing a physical object, we indicate which object by pointing and using reference terms, such as 'this' and 'that', to inform the listener quickly of an indicated object's location. Therefore, this research proposes using a three-layer attention-drawing model for humanoid robots that incorporates such gestures and verbal cues. The proposed three-layer model consists of three sub-models: the Reference Term Model (RTM); the Limit Distance Model (LDM); and the Object Property Model (OPM). The RTM selects an appropriate reference term for distance, based on a quantitative analysis of human behaviour. The LDM decides whether to use a property of the object, such as colour, as an additional term for distinguishing the object from its neighbours. The OPM determines which property should be used for this additional reference. Based on this concept, an attention-drawing system was developed for a communication robot named 'Robovie', and its effectiveness was tested.",
keywords = "Deictic gestures, Human-robot interaction, Human-robot interface",
author = "Osamu Sugiyama and Takayuki Kanda and Michita Imai and Hiroshi Ishiguro and Norihiro Hagita and Yuichiro Anzai",
year = "2006",
month = "12",
day = "1",
doi = "10.1080/09540090600890254",
language = "English",
volume = "18",
pages = "379--402",
journal = "Connection Science",
issn = "0954-0091",
publisher = "Taylor and Francis AS",
number = "4",

}

TY - JOUR

T1 - Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model

AU - Sugiyama, Osamu

AU - Kanda, Takayuki

AU - Imai, Michita

AU - Ishiguro, Hiroshi

AU - Hagita, Norihiro

AU - Anzai, Yuichiro

PY - 2006/12/1

Y1 - 2006/12/1

N2 - When describing a physical object, we indicate which object by pointing and using reference terms, such as 'this' and 'that', to inform the listener quickly of an indicated object's location. Therefore, this research proposes using a three-layer attention-drawing model for humanoid robots that incorporates such gestures and verbal cues. The proposed three-layer model consists of three sub-models: the Reference Term Model (RTM); the Limit Distance Model (LDM); and the Object Property Model (OPM). The RTM selects an appropriate reference term for distance, based on a quantitative analysis of human behaviour. The LDM decides whether to use a property of the object, such as colour, as an additional term for distinguishing the object from its neighbours. The OPM determines which property should be used for this additional reference. Based on this concept, an attention-drawing system was developed for a communication robot named 'Robovie', and its effectiveness was tested.

AB - When describing a physical object, we indicate which object by pointing and using reference terms, such as 'this' and 'that', to inform the listener quickly of an indicated object's location. Therefore, this research proposes using a three-layer attention-drawing model for humanoid robots that incorporates such gestures and verbal cues. The proposed three-layer model consists of three sub-models: the Reference Term Model (RTM); the Limit Distance Model (LDM); and the Object Property Model (OPM). The RTM selects an appropriate reference term for distance, based on a quantitative analysis of human behaviour. The LDM decides whether to use a property of the object, such as colour, as an additional term for distinguishing the object from its neighbours. The OPM determines which property should be used for this additional reference. Based on this concept, an attention-drawing system was developed for a communication robot named 'Robovie', and its effectiveness was tested.

KW - Deictic gestures

KW - Human-robot interaction

KW - Human-robot interface

UR - http://www.scopus.com/inward/record.url?scp=33750561686&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33750561686&partnerID=8YFLogxK

U2 - 10.1080/09540090600890254

DO - 10.1080/09540090600890254

M3 - Article

AN - SCOPUS:33750561686

VL - 18

SP - 379

EP - 402

JO - Connection Science

JF - Connection Science

SN - 0954-0091

IS - 4

ER -