Cosummary: Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions

Irshad Abibouraguimane, Yuta Itoh, Kakeru Hagihara, Yoichi Sato, Keita Higuchi, Tetsu Hayashida, Maki Sugimoto

Research output: Contribution to conferencePaper

Abstract

CoSummary, an adaptive video fast-forwarding technique for browsing surgical videos recorded by wearable cameras. Current wearable technologies allow us to record complex surgical skills, however, an efficient browsing technique for these videos is not well established. In order to assist browsing surgical videos, our study focuses on adaptively changing playback speeds through the learning and detecting collaborative scenes based on surgeon hand placement and gaze information. Our evaluation shows that the proposed method is able to highlight important collaborative scenes and skip less important scenes during surgical procedures. We have also performed a subjective study with surgeons in order to have professional feedback. The results confirmed the effectiveness of the proposed method in comparison to uniform video fast-forwarding.

Original languageEnglish
Pages580-590
Number of pages11
DOIs
Publication statusPublished - 2019 Jan 1
Event24th ACM International Conference on Intelligent User Interfaces, IUI 2019 - Marina del Ray, United States
Duration: 2019 Mar 172019 Mar 20

Conference

Conference24th ACM International Conference on Intelligent User Interfaces, IUI 2019
CountryUnited States
CityMarina del Ray
Period19/3/1719/3/20

Fingerprint

Cameras
Feedback
Wearable technology

Keywords

  • Adaptive Video Fast Forwarding
  • Collaborative Scene Detection
  • Gaze Positions
  • Hand Regions

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Abibouraguimane, I., Itoh, Y., Hagihara, K., Sato, Y., Higuchi, K., Hayashida, T., & Sugimoto, M. (2019). Cosummary: Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions. 580-590. Paper presented at 24th ACM International Conference on Intelligent User Interfaces, IUI 2019, Marina del Ray, United States. https://doi.org/10.1145/3301275.3302284

Cosummary : Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions. / Abibouraguimane, Irshad; Itoh, Yuta; Hagihara, Kakeru; Sato, Yoichi; Higuchi, Keita; Hayashida, Tetsu; Sugimoto, Maki.

2019. 580-590 Paper presented at 24th ACM International Conference on Intelligent User Interfaces, IUI 2019, Marina del Ray, United States.

Research output: Contribution to conferencePaper

Abibouraguimane, I, Itoh, Y, Hagihara, K, Sato, Y, Higuchi, K, Hayashida, T & Sugimoto, M 2019, 'Cosummary: Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions' Paper presented at 24th ACM International Conference on Intelligent User Interfaces, IUI 2019, Marina del Ray, United States, 19/3/17 - 19/3/20, pp. 580-590. https://doi.org/10.1145/3301275.3302284
Abibouraguimane I, Itoh Y, Hagihara K, Sato Y, Higuchi K, Hayashida T et al. Cosummary: Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions. 2019. Paper presented at 24th ACM International Conference on Intelligent User Interfaces, IUI 2019, Marina del Ray, United States. https://doi.org/10.1145/3301275.3302284
Abibouraguimane, Irshad ; Itoh, Yuta ; Hagihara, Kakeru ; Sato, Yoichi ; Higuchi, Keita ; Hayashida, Tetsu ; Sugimoto, Maki. / Cosummary : Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions. Paper presented at 24th ACM International Conference on Intelligent User Interfaces, IUI 2019, Marina del Ray, United States.11 p.
@conference{662967f3fc86441b94e59d9a83c76c71,
title = "Cosummary: Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions",
abstract = "CoSummary, an adaptive video fast-forwarding technique for browsing surgical videos recorded by wearable cameras. Current wearable technologies allow us to record complex surgical skills, however, an efficient browsing technique for these videos is not well established. In order to assist browsing surgical videos, our study focuses on adaptively changing playback speeds through the learning and detecting collaborative scenes based on surgeon hand placement and gaze information. Our evaluation shows that the proposed method is able to highlight important collaborative scenes and skip less important scenes during surgical procedures. We have also performed a subjective study with surgeons in order to have professional feedback. The results confirmed the effectiveness of the proposed method in comparison to uniform video fast-forwarding.",
keywords = "Adaptive Video Fast Forwarding, Collaborative Scene Detection, Gaze Positions, Hand Regions",
author = "Irshad Abibouraguimane and Yuta Itoh and Kakeru Hagihara and Yoichi Sato and Keita Higuchi and Tetsu Hayashida and Maki Sugimoto",
year = "2019",
month = "1",
day = "1",
doi = "10.1145/3301275.3302284",
language = "English",
pages = "580--590",
note = "24th ACM International Conference on Intelligent User Interfaces, IUI 2019 ; Conference date: 17-03-2019 Through 20-03-2019",

}

TY - CONF

T1 - Cosummary

T2 - Adaptive fast-forwarding for surgical videos by detecting collaborative scenes using hand regions and gaze positions

AU - Abibouraguimane, Irshad

AU - Itoh, Yuta

AU - Hagihara, Kakeru

AU - Sato, Yoichi

AU - Higuchi, Keita

AU - Hayashida, Tetsu

AU - Sugimoto, Maki

PY - 2019/1/1

Y1 - 2019/1/1

N2 - CoSummary, an adaptive video fast-forwarding technique for browsing surgical videos recorded by wearable cameras. Current wearable technologies allow us to record complex surgical skills, however, an efficient browsing technique for these videos is not well established. In order to assist browsing surgical videos, our study focuses on adaptively changing playback speeds through the learning and detecting collaborative scenes based on surgeon hand placement and gaze information. Our evaluation shows that the proposed method is able to highlight important collaborative scenes and skip less important scenes during surgical procedures. We have also performed a subjective study with surgeons in order to have professional feedback. The results confirmed the effectiveness of the proposed method in comparison to uniform video fast-forwarding.

AB - CoSummary, an adaptive video fast-forwarding technique for browsing surgical videos recorded by wearable cameras. Current wearable technologies allow us to record complex surgical skills, however, an efficient browsing technique for these videos is not well established. In order to assist browsing surgical videos, our study focuses on adaptively changing playback speeds through the learning and detecting collaborative scenes based on surgeon hand placement and gaze information. Our evaluation shows that the proposed method is able to highlight important collaborative scenes and skip less important scenes during surgical procedures. We have also performed a subjective study with surgeons in order to have professional feedback. The results confirmed the effectiveness of the proposed method in comparison to uniform video fast-forwarding.

KW - Adaptive Video Fast Forwarding

KW - Collaborative Scene Detection

KW - Gaze Positions

KW - Hand Regions

UR - http://www.scopus.com/inward/record.url?scp=85065565086&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065565086&partnerID=8YFLogxK

U2 - 10.1145/3301275.3302284

DO - 10.1145/3301275.3302284

M3 - Paper

AN - SCOPUS:85065565086

SP - 580

EP - 590

ER -