Reactive Chameleon

A Method to Mimic Conversation Partner’s Body Sway for a Robot

Ryosuke Hasumoto, Kazuhiro Nakadai, Michita Imai

Research output: Contribution to journalArticle

Abstract

Along with improvements in information processing capabilities and development of machine learning, research that robots provide services instead of people is progressing. In order to raise satisfaction with the service provided by the robot, it is important to build a robot that makes it easy for people to talk and can get a good impression from people. In human–human interaction, mimicking the conversation partner’s motion is one of the factors that influence the impression from the conversation partner. The influence coming from the mimicking in the interaction is called the “chameleon effect”. As the chameleon effect, it is known that a person unconsciously mimics interaction partner’s nonverbal behavior, in addition, it is also known that a good impression can be obtained from the interaction partner by consciously mimicking the partner’s nonverbal behavior without being noticed. Previous studies have shown that the chameleon effect occurs also even in human–robot interaction by mimicking interaction partner’s nonverbal behavior, and interaction partner has good impression on the robot. However, considering the conversation scene, there are problems with the method verified in the previous research when robots mimic interaction partner’s nonverbal behavior. The first problem is that the robot cannot perform gestures using its arms and head at the same time as mimicking nonverbal behavior during conversation. The second problem is that the conversation partner may notice that the robot mimics his/her nonverbal behavior during the conversation. In this thesis, we propose “Reactive Chameleon”, a method to generate body sway for a robot that based mimicking a conversation partner’s body sway. Reactive Chameleon designed for a robot to get a good impression from the conversation partner by chameleon effect without disturbing robot gestures. In Reactive Chameleon, the volume of the mimicking is dynamically adjusted to the conversation partner and the adjusted robot’s sway merged with robot’s own body sway for the conversation partner not to notice that robot mimics his/her body sway. We conducted an experiment to verify that the impression that the participant has toward the robot is affected by having a conversation with a robot that mimics a participant’s body sway. Results of the experiment show that the robot that imitates body sway with Reactive Chameleon got high evaluation from the conversation partner by chameleon effect.

Original languageEnglish
JournalInternational Journal of Social Robotics
DOIs
Publication statusPublished - 2019 Jan 1

Fingerprint

Robots
Learning systems
Experiments

Keywords

  • Body sway
  • Chameleon effect
  • Human–robot interaction

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Reactive Chameleon : A Method to Mimic Conversation Partner’s Body Sway for a Robot. / Hasumoto, Ryosuke; Nakadai, Kazuhiro; Imai, Michita.

In: International Journal of Social Robotics, 01.01.2019.

Research output: Contribution to journalArticle

@article{4c567783332f48459677dfa8aa31807f,
title = "Reactive Chameleon: A Method to Mimic Conversation Partner’s Body Sway for a Robot",
abstract = "Along with improvements in information processing capabilities and development of machine learning, research that robots provide services instead of people is progressing. In order to raise satisfaction with the service provided by the robot, it is important to build a robot that makes it easy for people to talk and can get a good impression from people. In human–human interaction, mimicking the conversation partner’s motion is one of the factors that influence the impression from the conversation partner. The influence coming from the mimicking in the interaction is called the “chameleon effect”. As the chameleon effect, it is known that a person unconsciously mimics interaction partner’s nonverbal behavior, in addition, it is also known that a good impression can be obtained from the interaction partner by consciously mimicking the partner’s nonverbal behavior without being noticed. Previous studies have shown that the chameleon effect occurs also even in human–robot interaction by mimicking interaction partner’s nonverbal behavior, and interaction partner has good impression on the robot. However, considering the conversation scene, there are problems with the method verified in the previous research when robots mimic interaction partner’s nonverbal behavior. The first problem is that the robot cannot perform gestures using its arms and head at the same time as mimicking nonverbal behavior during conversation. The second problem is that the conversation partner may notice that the robot mimics his/her nonverbal behavior during the conversation. In this thesis, we propose “Reactive Chameleon”, a method to generate body sway for a robot that based mimicking a conversation partner’s body sway. Reactive Chameleon designed for a robot to get a good impression from the conversation partner by chameleon effect without disturbing robot gestures. In Reactive Chameleon, the volume of the mimicking is dynamically adjusted to the conversation partner and the adjusted robot’s sway merged with robot’s own body sway for the conversation partner not to notice that robot mimics his/her body sway. We conducted an experiment to verify that the impression that the participant has toward the robot is affected by having a conversation with a robot that mimics a participant’s body sway. Results of the experiment show that the robot that imitates body sway with Reactive Chameleon got high evaluation from the conversation partner by chameleon effect.",
keywords = "Body sway, Chameleon effect, Human–robot interaction",
author = "Ryosuke Hasumoto and Kazuhiro Nakadai and Michita Imai",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/s12369-019-00557-4",
language = "English",
journal = "International Journal of Social Robotics",
issn = "1875-4791",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - Reactive Chameleon

T2 - A Method to Mimic Conversation Partner’s Body Sway for a Robot

AU - Hasumoto, Ryosuke

AU - Nakadai, Kazuhiro

AU - Imai, Michita

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Along with improvements in information processing capabilities and development of machine learning, research that robots provide services instead of people is progressing. In order to raise satisfaction with the service provided by the robot, it is important to build a robot that makes it easy for people to talk and can get a good impression from people. In human–human interaction, mimicking the conversation partner’s motion is one of the factors that influence the impression from the conversation partner. The influence coming from the mimicking in the interaction is called the “chameleon effect”. As the chameleon effect, it is known that a person unconsciously mimics interaction partner’s nonverbal behavior, in addition, it is also known that a good impression can be obtained from the interaction partner by consciously mimicking the partner’s nonverbal behavior without being noticed. Previous studies have shown that the chameleon effect occurs also even in human–robot interaction by mimicking interaction partner’s nonverbal behavior, and interaction partner has good impression on the robot. However, considering the conversation scene, there are problems with the method verified in the previous research when robots mimic interaction partner’s nonverbal behavior. The first problem is that the robot cannot perform gestures using its arms and head at the same time as mimicking nonverbal behavior during conversation. The second problem is that the conversation partner may notice that the robot mimics his/her nonverbal behavior during the conversation. In this thesis, we propose “Reactive Chameleon”, a method to generate body sway for a robot that based mimicking a conversation partner’s body sway. Reactive Chameleon designed for a robot to get a good impression from the conversation partner by chameleon effect without disturbing robot gestures. In Reactive Chameleon, the volume of the mimicking is dynamically adjusted to the conversation partner and the adjusted robot’s sway merged with robot’s own body sway for the conversation partner not to notice that robot mimics his/her body sway. We conducted an experiment to verify that the impression that the participant has toward the robot is affected by having a conversation with a robot that mimics a participant’s body sway. Results of the experiment show that the robot that imitates body sway with Reactive Chameleon got high evaluation from the conversation partner by chameleon effect.

AB - Along with improvements in information processing capabilities and development of machine learning, research that robots provide services instead of people is progressing. In order to raise satisfaction with the service provided by the robot, it is important to build a robot that makes it easy for people to talk and can get a good impression from people. In human–human interaction, mimicking the conversation partner’s motion is one of the factors that influence the impression from the conversation partner. The influence coming from the mimicking in the interaction is called the “chameleon effect”. As the chameleon effect, it is known that a person unconsciously mimics interaction partner’s nonverbal behavior, in addition, it is also known that a good impression can be obtained from the interaction partner by consciously mimicking the partner’s nonverbal behavior without being noticed. Previous studies have shown that the chameleon effect occurs also even in human–robot interaction by mimicking interaction partner’s nonverbal behavior, and interaction partner has good impression on the robot. However, considering the conversation scene, there are problems with the method verified in the previous research when robots mimic interaction partner’s nonverbal behavior. The first problem is that the robot cannot perform gestures using its arms and head at the same time as mimicking nonverbal behavior during conversation. The second problem is that the conversation partner may notice that the robot mimics his/her nonverbal behavior during the conversation. In this thesis, we propose “Reactive Chameleon”, a method to generate body sway for a robot that based mimicking a conversation partner’s body sway. Reactive Chameleon designed for a robot to get a good impression from the conversation partner by chameleon effect without disturbing robot gestures. In Reactive Chameleon, the volume of the mimicking is dynamically adjusted to the conversation partner and the adjusted robot’s sway merged with robot’s own body sway for the conversation partner not to notice that robot mimics his/her body sway. We conducted an experiment to verify that the impression that the participant has toward the robot is affected by having a conversation with a robot that mimics a participant’s body sway. Results of the experiment show that the robot that imitates body sway with Reactive Chameleon got high evaluation from the conversation partner by chameleon effect.

KW - Body sway

KW - Chameleon effect

KW - Human–robot interaction

UR - http://www.scopus.com/inward/record.url?scp=85066078457&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066078457&partnerID=8YFLogxK

U2 - 10.1007/s12369-019-00557-4

DO - 10.1007/s12369-019-00557-4

M3 - Article

JO - International Journal of Social Robotics

JF - International Journal of Social Robotics

SN - 1875-4791

ER -