Dynamics analysis of facial expressions for person identification

Hidenori Tanaka, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

We propose a new method for analyzing the dynamics of facial expressions to identify persons using Active Appearance Models and accurate facial feature point tracking. Several methods have been proposed to identify persons using facial images. In most methods, variations in facial expressions are one trouble factor. However, the dynamics of facial expressions are one measure of personal characteristics. In the proposed method, facial feature points are automatically extracted using Active Appearance Models in the first frame of each video. They are then tracked using the Lucas-Kanade based feature point tracking method. Next, a temporal interval is extracted from the beginning time to the ending time of facial expression changes. Finally, a feature vector is obtained. In the identification phase, an input feature vector is classified by calculating the distance between the input vector and the training vectors using dynamic programming matching. We show the effectiveness of the proposed method using smile videos from the MMI Facial Expression Database.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages107-115
Number of pages9
Volume5702 LNCS
DOIs
Publication statusPublished - 2009
Event13th International Conference on Computer Analysis of Images and Patterns, CAIP 2009 - Munster, Germany
Duration: 2009 Sep 22009 Sep 4

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5702 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other13th International Conference on Computer Analysis of Images and Patterns, CAIP 2009
CountryGermany
CityMunster
Period09/9/209/9/4

Fingerprint

Facial Expression
Dynamic Analysis
Dynamic analysis
Person
Feature Point
Active Appearance Models
Feature Vector
Dynamic programming
Dynamic Programming
Interval

Keywords

  • AAMs
  • DP matching
  • Facial expression analysis
  • LK-based feature point tracking
  • Person identification

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Tanaka, H., & Saito, H. (2009). Dynamics analysis of facial expressions for person identification. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5702 LNCS, pp. 107-115). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5702 LNCS). https://doi.org/10.1007/978-3-642-03767-2_13

Dynamics analysis of facial expressions for person identification. / Tanaka, Hidenori; Saito, Hideo.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5702 LNCS 2009. p. 107-115 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5702 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tanaka, H & Saito, H 2009, Dynamics analysis of facial expressions for person identification. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 5702 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5702 LNCS, pp. 107-115, 13th International Conference on Computer Analysis of Images and Patterns, CAIP 2009, Munster, Germany, 09/9/2. https://doi.org/10.1007/978-3-642-03767-2_13
Tanaka H, Saito H. Dynamics analysis of facial expressions for person identification. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5702 LNCS. 2009. p. 107-115. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-03767-2_13
Tanaka, Hidenori ; Saito, Hideo. / Dynamics analysis of facial expressions for person identification. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5702 LNCS 2009. pp. 107-115 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{3e038d6e0e9047ecb2fa298b7d13a757,
title = "Dynamics analysis of facial expressions for person identification",
abstract = "We propose a new method for analyzing the dynamics of facial expressions to identify persons using Active Appearance Models and accurate facial feature point tracking. Several methods have been proposed to identify persons using facial images. In most methods, variations in facial expressions are one trouble factor. However, the dynamics of facial expressions are one measure of personal characteristics. In the proposed method, facial feature points are automatically extracted using Active Appearance Models in the first frame of each video. They are then tracked using the Lucas-Kanade based feature point tracking method. Next, a temporal interval is extracted from the beginning time to the ending time of facial expression changes. Finally, a feature vector is obtained. In the identification phase, an input feature vector is classified by calculating the distance between the input vector and the training vectors using dynamic programming matching. We show the effectiveness of the proposed method using smile videos from the MMI Facial Expression Database.",
keywords = "AAMs, DP matching, Facial expression analysis, LK-based feature point tracking, Person identification",
author = "Hidenori Tanaka and Hideo Saito",
year = "2009",
doi = "10.1007/978-3-642-03767-2_13",
language = "English",
isbn = "3642037666",
volume = "5702 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "107--115",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Dynamics analysis of facial expressions for person identification

AU - Tanaka, Hidenori

AU - Saito, Hideo

PY - 2009

Y1 - 2009

N2 - We propose a new method for analyzing the dynamics of facial expressions to identify persons using Active Appearance Models and accurate facial feature point tracking. Several methods have been proposed to identify persons using facial images. In most methods, variations in facial expressions are one trouble factor. However, the dynamics of facial expressions are one measure of personal characteristics. In the proposed method, facial feature points are automatically extracted using Active Appearance Models in the first frame of each video. They are then tracked using the Lucas-Kanade based feature point tracking method. Next, a temporal interval is extracted from the beginning time to the ending time of facial expression changes. Finally, a feature vector is obtained. In the identification phase, an input feature vector is classified by calculating the distance between the input vector and the training vectors using dynamic programming matching. We show the effectiveness of the proposed method using smile videos from the MMI Facial Expression Database.

AB - We propose a new method for analyzing the dynamics of facial expressions to identify persons using Active Appearance Models and accurate facial feature point tracking. Several methods have been proposed to identify persons using facial images. In most methods, variations in facial expressions are one trouble factor. However, the dynamics of facial expressions are one measure of personal characteristics. In the proposed method, facial feature points are automatically extracted using Active Appearance Models in the first frame of each video. They are then tracked using the Lucas-Kanade based feature point tracking method. Next, a temporal interval is extracted from the beginning time to the ending time of facial expression changes. Finally, a feature vector is obtained. In the identification phase, an input feature vector is classified by calculating the distance between the input vector and the training vectors using dynamic programming matching. We show the effectiveness of the proposed method using smile videos from the MMI Facial Expression Database.

KW - AAMs

KW - DP matching

KW - Facial expression analysis

KW - LK-based feature point tracking

KW - Person identification

UR - http://www.scopus.com/inward/record.url?scp=70349332920&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349332920&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-03767-2_13

DO - 10.1007/978-3-642-03767-2_13

M3 - Conference contribution

AN - SCOPUS:70349332920

SN - 3642037666

SN - 9783642037665

VL - 5702 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 107

EP - 115

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -