Automatic viewpoint switching for multi-view surgical videos

Tomohiro Shimizu, Kei Oishi, Hideo Saito, Hiroki Kajita, Yoshifumi Takatsume

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recording medical surgery operations is important for sharing the various operating techniques. In most operating rooms, fixed surgery cameras are already installed, but it is almost impossible to capture the surgical field because of occlusion by the surgeon's head and body. In order to capture the surgical field in real surgery operations, we proposed the installation of multiple cameras in a surgical lighting system, so that at least one camera can capture the target surgical field even when the surgeon's head and body occlude other cameras. In this paper, we present a method for automatic viewpoint selection from multi-view surgical videos, so that the surgical field can always be recorded in the output video. We employ a method for learning-based object detection from videos for automatic evaluation of the surgical field area from multiple input videos. By selecting the viewpoint with the largest area of the surgical field, we can virtually reduce the area of the surgeon's head and hands. In general, frequent camera switching degrades the video quality of view (QoV). Therefore, we apply the Dijkstra method widely used in the shortest path problem as a combinatorial optimization method for this problem. Our camera scheduling method is that the camera switching is not performed for a certain period of time, and the surgical field observed in the entire video is maximized.

Original languageEnglish
Title of host publicationAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages89-90
Number of pages2
ISBN (Electronic)9781728147659
DOIs
Publication statusPublished - 2019 Oct
Event18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 - Beijing, China
Duration: 2019 Oct 142019 Oct 18

Publication series

NameAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019

Conference

Conference18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
CountryChina
CityBeijing
Period19/10/1419/10/18

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction
  • Media Technology

Fingerprint Dive into the research topics of 'Automatic viewpoint switching for multi-view surgical videos'. Together they form a unique fingerprint.

  • Cite this

    Shimizu, T., Oishi, K., Saito, H., Kajita, H., & Takatsume, Y. (2019). Automatic viewpoint switching for multi-view surgical videos. In Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 (pp. 89-90). [8951906] (Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR-Adjunct.2019.00037