Video-annotated augmented reality assembly tutorials

Masahiro Yamaguchi, Shohei Mori, Peter Mohr, Markus Tatzgern, Ana Stanescu, Hideo Saito, Denis Kalkofen

研究成果: Conference contribution

抄録

We present a system for generating and visualizing interactive 3D Augmented Reality tutorials based on 2D video input, which allows viewpoint control at runtime. Inspired by assembly planning, we analyze the input video using a 3D CAD model of the object to determine an assembly graph that encodes blocking relationships between parts. Using an assembly graph enables us to detect assembly steps that are otherwise difficult to extract from the video, and generally improves object detection and tracking by providing prior knowledge about movable parts. To avoid information loss, we combine the 3D animation with relevant parts of the 2D video so that we can show detailed manipulations and tool usage that cannot be easily extracted from the video. To further support user orientation, we visually align the 3D animation with the real-world object by using texture information from the input video. We developed a presentation system that uses commonly available hardware to make our results accessible for home use and demonstrate the effectiveness of our approach by comparing it to traditional video tutorials.

本文言語English
ホスト出版物のタイトルUIST 2020 - Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology
出版社Association for Computing Machinery, Inc
ページ1010-1022
ページ数13
ISBN(電子版)9781450375146
DOI
出版ステータスPublished - 2020 10 20
イベント33rd Annual ACM Symposium on User Interface Software and Technology, UIST 2020 - Virtual, Online, United States
継続期間: 2020 10 202020 10 23

出版物シリーズ

名前UIST 2020 - Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

Conference

Conference33rd Annual ACM Symposium on User Interface Software and Technology, UIST 2020
CountryUnited States
CityVirtual, Online
Period20/10/2020/10/23

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

フィンガープリント 「Video-annotated augmented reality assembly tutorials」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル