FOE-based regularization for optical flow estimation from an in-vehicle event camera

Jun Nagata, Yusuke Sekikawa, Kosuke Hara, Yoshimitsu Aoki

Research output: Contribution to journalArticle

Abstract

Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.

Original languageEnglish
Pages (from-to)1113-1118
Number of pages6
JournalIEEJ Transactions on Electronics, Information and Systems
Volume139
Issue number10
DOIs
Publication statusPublished - 2019 Jan 1

Fingerprint

Optical flows
Cameras
Pixels

Keywords

  • Event camera
  • Focus of expansion
  • Optical flow

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

FOE-based regularization for optical flow estimation from an in-vehicle event camera. / Nagata, Jun; Sekikawa, Yusuke; Hara, Kosuke; Aoki, Yoshimitsu.

In: IEEJ Transactions on Electronics, Information and Systems, Vol. 139, No. 10, 01.01.2019, p. 1113-1118.

Research output: Contribution to journalArticle

@article{d533996c9872447caaedb0feaa380703,
title = "FOE-based regularization for optical flow estimation from an in-vehicle event camera",
abstract = "Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.",
keywords = "Event camera, Focus of expansion, Optical flow",
author = "Jun Nagata and Yusuke Sekikawa and Kosuke Hara and Yoshimitsu Aoki",
year = "2019",
month = "1",
day = "1",
doi = "10.1541/ieejeiss.139.1113",
language = "English",
volume = "139",
pages = "1113--1118",
journal = "IEEJ Transactions on Electronics, Information and Systems",
issn = "0385-4221",
publisher = "The Institute of Electrical Engineers of Japan",
number = "10",

}

TY - JOUR

T1 - FOE-based regularization for optical flow estimation from an in-vehicle event camera

AU - Nagata, Jun

AU - Sekikawa, Yusuke

AU - Hara, Kosuke

AU - Aoki, Yoshimitsu

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.

AB - Optical flow estimation from an in-vehicle camera is an important task in automatic driving and advanced driver- A ssistance systems. However, there is a problem that optical flow estimation is mistakable with high contrast and high speed. Event camera can overcome these situations because it reports only the per-pixel intensity change with high dynamic range and low latency. However, the LI smoothness regularization in the conventional optical flow estimation method is not suitable for radial optical flow in the driving scene. Therefore, we propose to use the focus of expansion (FOE) for regularization of optical flow estimation in event camera. The FOE is defined as the intersection of the translation vector of the camera and the image plane. The optical flow becomes radial from the FOE excluding the rotational component. Using the property, the optical flow can be regularized in the correct direction in the optimization process. We demonstrated that the optical flow was improved by introducing our regularization using the public dataset.

KW - Event camera

KW - Focus of expansion

KW - Optical flow

UR - http://www.scopus.com/inward/record.url?scp=85072792492&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85072792492&partnerID=8YFLogxK

U2 - 10.1541/ieejeiss.139.1113

DO - 10.1541/ieejeiss.139.1113

M3 - Article

AN - SCOPUS:85072792492

VL - 139

SP - 1113

EP - 1118

JO - IEEJ Transactions on Electronics, Information and Systems

JF - IEEJ Transactions on Electronics, Information and Systems

SN - 0385-4221

IS - 10

ER -