Exploiting the accuracy-acceleration tradeoff: VINS-assisted real-time object detection on moving systems

Betty Le Dem, Kazuo Nakazawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent years, Convolutional Neural Networks (CNNs) have repeatedly shown state-of-the-art performance for their accuracy in the task of object detection, but their heavy computational costs impede their ability for real-time detection when the supporting system is moving, particulary when it is accelerating. At the same time, recent progress on visual inertial systems takes great advantage of movement information to robustly estimate the robot state and its surrounding. This paper proposes to exploit the advantages of inertial odometry research for the purpose of real-time object detection system on mobile robots. We combine a CNN detector with VINS-Mono, a moving visual odometry system, and show reliable improvement in the detection process, especially when the robot accelerates or decelerates. Our system is ready-to-use in that it has very low deployment cost and requires no calibration. The resulting system allows for simultaneous robot state estimation and object detection, as well as object tracking. Lastly, this architecture proves to be flexible because not restrained to a specific object type or detector.

Original languageEnglish
Title of host publicationProceedings of the 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages483-488
Number of pages6
ISBN (Electronic)9781728124933
DOIs
Publication statusPublished - 2019 Jul
Event2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2019 - Hong Kong, China
Duration: 2019 Jul 82019 Jul 12

Publication series

NameIEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM
Volume2019-July

Conference

Conference2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2019
CountryChina
CityHong Kong
Period19/7/819/7/12

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Computer Science Applications
  • Software

Fingerprint Dive into the research topics of 'Exploiting the accuracy-acceleration tradeoff: VINS-assisted real-time object detection on moving systems'. Together they form a unique fingerprint.

Cite this