An entertainment robot based on head pose estimation and facial expression recognition

Koichi Takahashi; Yasue Mitsukura

An entertainment robot based on head pose estimation and facial expression recognition

Koichi Takahashi, Yasue Mitsukura

Department of System Design Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Citations (Scopus)

Abstract

In this paper, we propose a novel entertainment robot system that can act/react to humans. In the entertainment robots, how to act/react is the fundamental challenge. In general, it is very difficult for robots to automatically decide their behavior that human want to. Therefore entertainment robots with operator's assistance are quite effective for designing practical system. Our proposed system is based on the computer vision technologies: head pose estimation and facial expression recognition. Our system leads to the commercially available entertainment robot to act/react to humans based on puppeteering by the operators head motion instead of autonomous behavior.

Original language	English
Title of host publication	2012 Proceedings of SICE Annual Conference, SICE 2012
Publisher	Society of Instrument and Control Engineers (SICE)
Pages	2057-2061
Number of pages	5
ISBN (Print)	9781467322591
Publication status	Published - 2012
Event	2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012 - Akita, Japan Duration: 2012 Aug 20 → 2012 Aug 23

Publication series

Name	Proceedings of the SICE Annual Conference

Other

Other	2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012
Country/Territory	Japan
City	Akita
Period	12/8/20 → 12/8/23

Keywords

Entertainment robot
Facial expression recognition
Head pose estimation
Pattern measurement

ASJC Scopus subject areas

Control and Systems Engineering
Computer Science Applications
Electrical and Electronic Engineering

Cite this

An entertainment robot based on head pose estimation and facial expression recognition. / Takahashi, Koichi; Mitsukura, Yasue.
2012 Proceedings of SICE Annual Conference, SICE 2012. Society of Instrument and Control Engineers (SICE), 2012. p. 2057-2061 6318352 (Proceedings of the SICE Annual Conference).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Takahashi, K & Mitsukura, Y 2012, An entertainment robot based on head pose estimation and facial expression recognition. in 2012 Proceedings of SICE Annual Conference, SICE 2012., 6318352, Proceedings of the SICE Annual Conference, Society of Instrument and Control Engineers (SICE), pp. 2057-2061, 2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012, Akita, Japan, 12/8/20.

@inproceedings{5cc7431a0fb2493fb82d8a06c36fc8a3,

title = "An entertainment robot based on head pose estimation and facial expression recognition",

abstract = "In this paper, we propose a novel entertainment robot system that can act/react to humans. In the entertainment robots, how to act/react is the fundamental challenge. In general, it is very difficult for robots to automatically decide their behavior that human want to. Therefore entertainment robots with operator's assistance are quite effective for designing practical system. Our proposed system is based on the computer vision technologies: head pose estimation and facial expression recognition. Our system leads to the commercially available entertainment robot to act/react to humans based on puppeteering by the operators head motion instead of autonomous behavior.",

keywords = "Entertainment robot, Facial expression recognition, Head pose estimation, Pattern measurement",

author = "Koichi Takahashi and Yasue Mitsukura",

year = "2012",

language = "English",

isbn = "9781467322591",

series = "Proceedings of the SICE Annual Conference",

publisher = "Society of Instrument and Control Engineers (SICE)",

pages = "2057--2061",

booktitle = "2012 Proceedings of SICE Annual Conference, SICE 2012",

note = "2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012 ; Conference date: 20-08-2012 Through 23-08-2012",

}

TY - GEN

T1 - An entertainment robot based on head pose estimation and facial expression recognition

AU - Takahashi, Koichi

AU - Mitsukura, Yasue

PY - 2012

Y1 - 2012

N2 - In this paper, we propose a novel entertainment robot system that can act/react to humans. In the entertainment robots, how to act/react is the fundamental challenge. In general, it is very difficult for robots to automatically decide their behavior that human want to. Therefore entertainment robots with operator's assistance are quite effective for designing practical system. Our proposed system is based on the computer vision technologies: head pose estimation and facial expression recognition. Our system leads to the commercially available entertainment robot to act/react to humans based on puppeteering by the operators head motion instead of autonomous behavior.

AB - In this paper, we propose a novel entertainment robot system that can act/react to humans. In the entertainment robots, how to act/react is the fundamental challenge. In general, it is very difficult for robots to automatically decide their behavior that human want to. Therefore entertainment robots with operator's assistance are quite effective for designing practical system. Our proposed system is based on the computer vision technologies: head pose estimation and facial expression recognition. Our system leads to the commercially available entertainment robot to act/react to humans based on puppeteering by the operators head motion instead of autonomous behavior.

KW - Entertainment robot

KW - Facial expression recognition

KW - Head pose estimation

KW - Pattern measurement

UR - http://www.scopus.com/inward/record.url?scp=84869455417&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84869455417&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84869455417

SN - 9781467322591

T3 - Proceedings of the SICE Annual Conference

SP - 2057

EP - 2061

BT - 2012 Proceedings of SICE Annual Conference, SICE 2012

PB - Society of Instrument and Control Engineers (SICE)

T2 - 2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012

Y2 - 20 August 2012 through 23 August 2012

ER -

An entertainment robot based on head pose estimation and facial expression recognition

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this