An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar

Kei Oishi, Shohei Mori, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Diminished reality (DR) enables us to see through real objects occluding some areas in our field of view. This interactive display has various applications, such as see-through vision to visualize invisible areas, work area visualization in surgery and landscape simulation. In this paper, we propose two underlying problems in see-through vision, in which hidden areas are observed in real time. First, see-through vision methods require a common area to calibrate every camera in the environment. However, the field of view is limited and many approaches rely on a time-consuming calibration, sensors, or fiducial markers. Second, see-through vision applications assume that the background is planar to ease image alignment. We therefore present a place-and-play see-through vision system using a wide field-of-view RGB-D camera. We validated the accuracy and the robustness of our system and showed results in various environments to show the applicability.

Original languageEnglish
Title of host publicationAdjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages344-347
Number of pages4
ISBN (Electronic)9780769563275
DOIs
Publication statusPublished - 2017 Oct 27
Event16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017 - Nantes, France
Duration: 2017 Oct 92017 Oct 13

Other

Other16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017
CountryFrance
CityNantes
Period17/10/917/10/13

Fingerprint

Optical radar
Cameras
Surgery
Visualization
Display devices
Calibration
Sensors

Keywords

  • 3D-Lidar
  • Diminished reality
  • Fish-eye camera

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Media Technology
  • Computer Science Applications

Cite this

Oishi, K., Mori, S., & Saito, H. (2017). An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar. In Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017 (pp. 344-347). [8088518] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR-Adjunct.2017.99

An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar. / Oishi, Kei; Mori, Shohei; Saito, Hideo.

Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 344-347 8088518.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Oishi, K, Mori, S & Saito, H 2017, An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar. in Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017., 8088518, Institute of Electrical and Electronics Engineers Inc., pp. 344-347, 16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017, Nantes, France, 17/10/9. https://doi.org/10.1109/ISMAR-Adjunct.2017.99
Oishi K, Mori S, Saito H. An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar. In Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 344-347. 8088518 https://doi.org/10.1109/ISMAR-Adjunct.2017.99
Oishi, Kei ; Mori, Shohei ; Saito, Hideo. / An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar. Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 344-347
@inproceedings{ae6febcd995146b89377c27539b75eac,
title = "An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar",
abstract = "Diminished reality (DR) enables us to see through real objects occluding some areas in our field of view. This interactive display has various applications, such as see-through vision to visualize invisible areas, work area visualization in surgery and landscape simulation. In this paper, we propose two underlying problems in see-through vision, in which hidden areas are observed in real time. First, see-through vision methods require a common area to calibrate every camera in the environment. However, the field of view is limited and many approaches rely on a time-consuming calibration, sensors, or fiducial markers. Second, see-through vision applications assume that the background is planar to ease image alignment. We therefore present a place-and-play see-through vision system using a wide field-of-view RGB-D camera. We validated the accuracy and the robustness of our system and showed results in various environments to show the applicability.",
keywords = "3D-Lidar, Diminished reality, Fish-eye camera",
author = "Kei Oishi and Shohei Mori and Hideo Saito",
year = "2017",
month = "10",
day = "27",
doi = "10.1109/ISMAR-Adjunct.2017.99",
language = "English",
pages = "344--347",
booktitle = "Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - An Instant See-Through Vision System Using a Wide Field-of-View Camera and a 3D-Lidar

AU - Oishi, Kei

AU - Mori, Shohei

AU - Saito, Hideo

PY - 2017/10/27

Y1 - 2017/10/27

N2 - Diminished reality (DR) enables us to see through real objects occluding some areas in our field of view. This interactive display has various applications, such as see-through vision to visualize invisible areas, work area visualization in surgery and landscape simulation. In this paper, we propose two underlying problems in see-through vision, in which hidden areas are observed in real time. First, see-through vision methods require a common area to calibrate every camera in the environment. However, the field of view is limited and many approaches rely on a time-consuming calibration, sensors, or fiducial markers. Second, see-through vision applications assume that the background is planar to ease image alignment. We therefore present a place-and-play see-through vision system using a wide field-of-view RGB-D camera. We validated the accuracy and the robustness of our system and showed results in various environments to show the applicability.

AB - Diminished reality (DR) enables us to see through real objects occluding some areas in our field of view. This interactive display has various applications, such as see-through vision to visualize invisible areas, work area visualization in surgery and landscape simulation. In this paper, we propose two underlying problems in see-through vision, in which hidden areas are observed in real time. First, see-through vision methods require a common area to calibrate every camera in the environment. However, the field of view is limited and many approaches rely on a time-consuming calibration, sensors, or fiducial markers. Second, see-through vision applications assume that the background is planar to ease image alignment. We therefore present a place-and-play see-through vision system using a wide field-of-view RGB-D camera. We validated the accuracy and the robustness of our system and showed results in various environments to show the applicability.

KW - 3D-Lidar

KW - Diminished reality

KW - Fish-eye camera

UR - http://www.scopus.com/inward/record.url?scp=85040237698&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85040237698&partnerID=8YFLogxK

U2 - 10.1109/ISMAR-Adjunct.2017.99

DO - 10.1109/ISMAR-Adjunct.2017.99

M3 - Conference contribution

AN - SCOPUS:85040237698

SP - 344

EP - 347

BT - Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -