FOE-based regularization for optical flow estimation from an in-vehicle event camera

Jun Nagata, Yusuke Sekikawa, Kosuke Hara, Yoshimitsu Aoki

研究成果: Article

抄録

Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.

元の言語English
ページ(範囲)1113-1118
ページ数6
ジャーナルIEEJ Transactions on Electronics, Information and Systems
139
発行部数10
DOI
出版物ステータスPublished - 2019 1 1

Fingerprint

Optical flows
Cameras
Pixels

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

これを引用

FOE-based regularization for optical flow estimation from an in-vehicle event camera. / Nagata, Jun; Sekikawa, Yusuke; Hara, Kosuke; Aoki, Yoshimitsu.

:: IEEJ Transactions on Electronics, Information and Systems, 巻 139, 番号 10, 01.01.2019, p. 1113-1118.

研究成果: Article

@article{d533996c9872447caaedb0feaa380703,
title = "FOE-based regularization for optical flow estimation from an in-vehicle event camera",
abstract = "Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.",
keywords = "Event camera, Focus of expansion, Optical flow",
author = "Jun Nagata and Yusuke Sekikawa and Kosuke Hara and Yoshimitsu Aoki",
year = "2019",
month = "1",
day = "1",
doi = "10.1541/ieejeiss.139.1113",
language = "English",
volume = "139",
pages = "1113--1118",
journal = "IEEJ Transactions on Electronics, Information and Systems",
issn = "0385-4221",
publisher = "The Institute of Electrical Engineers of Japan",
number = "10",

}

TY - JOUR

T1 - FOE-based regularization for optical flow estimation from an in-vehicle event camera

AU - Nagata, Jun

AU - Sekikawa, Yusuke

AU - Hara, Kosuke

AU - Aoki, Yoshimitsu

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.

AB - Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.

KW - Event camera

KW - Focus of expansion

KW - Optical flow

UR - http://www.scopus.com/inward/record.url?scp=85072792492&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072792492&partnerID=8YFLogxK

U2 - 10.1541/ieejeiss.139.1113

DO - 10.1541/ieejeiss.139.1113

M3 - Article

AN - SCOPUS:85072792492

VL - 139

SP - 1113

EP - 1118

JO - IEEJ Transactions on Electronics, Information and Systems

JF - IEEJ Transactions on Electronics, Information and Systems

SN - 0385-4221

IS - 10

ER -