3D head pose tracking using a particle filter with nose template matching

Hitoshi Kubota, Masami Takeshi, Hideo Saito

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

In this paper, we propose a real-time tracking method for driver's head pose in real vehicle environment by using multiple NIR cameras. In order to achieve real-time performance and high-accuracy, 6-DOF of head pose is estimated by a particle filter with restricted state space. Firstly, the 3D position of nose hole is measured by template matching of stereo images. Because nose hole is the most dark area in the captured NIR images, we can robustly detect the position of the nose very precisely. From the 3D position of the nose, we can estimate the head pose as an initial estimate. Then, each hypothesis is updated by prior probability with a constraint of nose position. Thus it can reduce the number of particles with maintained accuracy. The experimental results indicate that this method is effective for head pose tracking.

Original languageEnglish
JournalIEEJ Transactions on Electronics, Information and Systems
Volume128
Issue number9
DOIs
Publication statusPublished - 2008

Fingerprint

Template matching
Cameras

Keywords

  • Driver
  • Head pose tracking
  • Nose hole
  • Particle filter
  • Template matching
  • View direction tracking

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

3D head pose tracking using a particle filter with nose template matching. / Kubota, Hitoshi; Takeshi, Masami; Saito, Hideo.

In: IEEJ Transactions on Electronics, Information and Systems, Vol. 128, No. 9, 2008.

Research output: Contribution to journalArticle

@article{6eb822b9733847bdad096ab16f2d6186,
title = "3D head pose tracking using a particle filter with nose template matching",
abstract = "In this paper, we propose a real-time tracking method for driver's head pose in real vehicle environment by using multiple NIR cameras. In order to achieve real-time performance and high-accuracy, 6-DOF of head pose is estimated by a particle filter with restricted state space. Firstly, the 3D position of nose hole is measured by template matching of stereo images. Because nose hole is the most dark area in the captured NIR images, we can robustly detect the position of the nose very precisely. From the 3D position of the nose, we can estimate the head pose as an initial estimate. Then, each hypothesis is updated by prior probability with a constraint of nose position. Thus it can reduce the number of particles with maintained accuracy. The experimental results indicate that this method is effective for head pose tracking.",
keywords = "Driver, Head pose tracking, Nose hole, Particle filter, Template matching, View direction tracking",
author = "Hitoshi Kubota and Masami Takeshi and Hideo Saito",
year = "2008",
doi = "10.1541/ieejeiss.128.1447",
language = "English",
volume = "128",
journal = "IEEJ Transactions on Electronics, Information and Systems",
issn = "0385-4221",
publisher = "The Institute of Electrical Engineers of Japan",
number = "9",

}

TY - JOUR

T1 - 3D head pose tracking using a particle filter with nose template matching

AU - Kubota, Hitoshi

AU - Takeshi, Masami

AU - Saito, Hideo

PY - 2008

Y1 - 2008

N2 - In this paper, we propose a real-time tracking method for driver's head pose in real vehicle environment by using multiple NIR cameras. In order to achieve real-time performance and high-accuracy, 6-DOF of head pose is estimated by a particle filter with restricted state space. Firstly, the 3D position of nose hole is measured by template matching of stereo images. Because nose hole is the most dark area in the captured NIR images, we can robustly detect the position of the nose very precisely. From the 3D position of the nose, we can estimate the head pose as an initial estimate. Then, each hypothesis is updated by prior probability with a constraint of nose position. Thus it can reduce the number of particles with maintained accuracy. The experimental results indicate that this method is effective for head pose tracking.

AB - In this paper, we propose a real-time tracking method for driver's head pose in real vehicle environment by using multiple NIR cameras. In order to achieve real-time performance and high-accuracy, 6-DOF of head pose is estimated by a particle filter with restricted state space. Firstly, the 3D position of nose hole is measured by template matching of stereo images. Because nose hole is the most dark area in the captured NIR images, we can robustly detect the position of the nose very precisely. From the 3D position of the nose, we can estimate the head pose as an initial estimate. Then, each hypothesis is updated by prior probability with a constraint of nose position. Thus it can reduce the number of particles with maintained accuracy. The experimental results indicate that this method is effective for head pose tracking.

KW - Driver

KW - Head pose tracking

KW - Nose hole

KW - Particle filter

KW - Template matching

KW - View direction tracking

UR - http://www.scopus.com/inward/record.url?scp=72549115816&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=72549115816&partnerID=8YFLogxK

U2 - 10.1541/ieejeiss.128.1447

DO - 10.1541/ieejeiss.128.1447

M3 - Article

VL - 128

JO - IEEJ Transactions on Electronics, Information and Systems

JF - IEEJ Transactions on Electronics, Information and Systems

SN - 0385-4221

IS - 9

ER -