Task support system by displaying instructional video onto AR workspace

Michihiko Goto, Yuko Uematsu, Hideo Saito, Shuji Senda, Akihiko Iketani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

17 Citations (Scopus)

Abstract

This paper presents an instructional support system based on augmented reality (AR). This system helps a user to work intuitively by overlaying visual information in the same way of a navigation system. In usual AR systems, the contents to be overlaid onto real space are created with 3D Computer Graphics. In most cases, such contents are newly created according to applications. However, there are many 2D videos that show how to take apart or build electric appliances and PCs, how to cook, etc. Therefore, our system employs such existing 2D videos as instructional videos. By transforming an instructional video to display, according to the user's view, and by overlaying the video onto the user's view space, the proposed system intuitively provides the user with visual guidance. In order to avoid the problem that the display of the instructional video and the user's view may be visually confused, we add various visual effects to the instructional video, such as transparency and enhancement of contours. By dividing the instructional video into sections according to the operations to be carried out in order to complete a certain task, we ensure that the user can interactively move to the next step in the instructional video after a certain operation is completed. Therefore, the user can carry on with the task at his/her own pace. In the usability test, users evaluated the use of the instructional video in our system through two tasks: a task involving building blocks and an origami task. As a result, we found that a user's visibility improves when the instructional video is transformed to display according to his/her view. Further, for the evaluation of visual effects, we can classify these effects according to the task and obtain the guideline for the use of our system as an instructional support system for performing various other tasks.

Original languageEnglish
Title of host publication9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings
Pages83-90
Number of pages8
DOIs
Publication statusPublished - 2010
Event9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Seoul, Korea, Republic of
Duration: 2010 Oct 132010 Oct 16

Other

Other9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010
CountryKorea, Republic of
CitySeoul
Period10/10/1310/10/16

Fingerprint

Augmented reality
Electric appliances
Computer graphics
Navigation systems
Visibility
Transparency
Display devices

Keywords

  • H.5.1 [information interfaces and presentation]: Multimedia information systems - Artificial, augmented, and virtual realities
  • H.5.2 [information interfaces and presentation]: User interfaces - Training, help, and documentation

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics

Cite this

Goto, M., Uematsu, Y., Saito, H., Senda, S., & Iketani, A. (2010). Task support system by displaying instructional video onto AR workspace. In 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings (pp. 83-90). [5643554] https://doi.org/10.1109/ISMAR.2010.5643554

Task support system by displaying instructional video onto AR workspace. / Goto, Michihiko; Uematsu, Yuko; Saito, Hideo; Senda, Shuji; Iketani, Akihiko.

9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings. 2010. p. 83-90 5643554.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Goto, M, Uematsu, Y, Saito, H, Senda, S & Iketani, A 2010, Task support system by displaying instructional video onto AR workspace. in 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings., 5643554, pp. 83-90, 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010, Seoul, Korea, Republic of, 10/10/13. https://doi.org/10.1109/ISMAR.2010.5643554
Goto M, Uematsu Y, Saito H, Senda S, Iketani A. Task support system by displaying instructional video onto AR workspace. In 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings. 2010. p. 83-90. 5643554 https://doi.org/10.1109/ISMAR.2010.5643554
Goto, Michihiko ; Uematsu, Yuko ; Saito, Hideo ; Senda, Shuji ; Iketani, Akihiko. / Task support system by displaying instructional video onto AR workspace. 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings. 2010. pp. 83-90
@inproceedings{9ffcd86010534ea2a2ad2df23c3d72fb,
title = "Task support system by displaying instructional video onto AR workspace",
abstract = "This paper presents an instructional support system based on augmented reality (AR). This system helps a user to work intuitively by overlaying visual information in the same way of a navigation system. In usual AR systems, the contents to be overlaid onto real space are created with 3D Computer Graphics. In most cases, such contents are newly created according to applications. However, there are many 2D videos that show how to take apart or build electric appliances and PCs, how to cook, etc. Therefore, our system employs such existing 2D videos as instructional videos. By transforming an instructional video to display, according to the user's view, and by overlaying the video onto the user's view space, the proposed system intuitively provides the user with visual guidance. In order to avoid the problem that the display of the instructional video and the user's view may be visually confused, we add various visual effects to the instructional video, such as transparency and enhancement of contours. By dividing the instructional video into sections according to the operations to be carried out in order to complete a certain task, we ensure that the user can interactively move to the next step in the instructional video after a certain operation is completed. Therefore, the user can carry on with the task at his/her own pace. In the usability test, users evaluated the use of the instructional video in our system through two tasks: a task involving building blocks and an origami task. As a result, we found that a user's visibility improves when the instructional video is transformed to display according to his/her view. Further, for the evaluation of visual effects, we can classify these effects according to the task and obtain the guideline for the use of our system as an instructional support system for performing various other tasks.",
keywords = "H.5.1 [information interfaces and presentation]: Multimedia information systems - Artificial, augmented, and virtual realities, H.5.2 [information interfaces and presentation]: User interfaces - Training, help, and documentation",
author = "Michihiko Goto and Yuko Uematsu and Hideo Saito and Shuji Senda and Akihiko Iketani",
year = "2010",
doi = "10.1109/ISMAR.2010.5643554",
language = "English",
isbn = "9781424493449",
pages = "83--90",
booktitle = "9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings",

}

TY - GEN

T1 - Task support system by displaying instructional video onto AR workspace

AU - Goto, Michihiko

AU - Uematsu, Yuko

AU - Saito, Hideo

AU - Senda, Shuji

AU - Iketani, Akihiko

PY - 2010

Y1 - 2010

N2 - This paper presents an instructional support system based on augmented reality (AR). This system helps a user to work intuitively by overlaying visual information in the same way of a navigation system. In usual AR systems, the contents to be overlaid onto real space are created with 3D Computer Graphics. In most cases, such contents are newly created according to applications. However, there are many 2D videos that show how to take apart or build electric appliances and PCs, how to cook, etc. Therefore, our system employs such existing 2D videos as instructional videos. By transforming an instructional video to display, according to the user's view, and by overlaying the video onto the user's view space, the proposed system intuitively provides the user with visual guidance. In order to avoid the problem that the display of the instructional video and the user's view may be visually confused, we add various visual effects to the instructional video, such as transparency and enhancement of contours. By dividing the instructional video into sections according to the operations to be carried out in order to complete a certain task, we ensure that the user can interactively move to the next step in the instructional video after a certain operation is completed. Therefore, the user can carry on with the task at his/her own pace. In the usability test, users evaluated the use of the instructional video in our system through two tasks: a task involving building blocks and an origami task. As a result, we found that a user's visibility improves when the instructional video is transformed to display according to his/her view. Further, for the evaluation of visual effects, we can classify these effects according to the task and obtain the guideline for the use of our system as an instructional support system for performing various other tasks.

AB - This paper presents an instructional support system based on augmented reality (AR). This system helps a user to work intuitively by overlaying visual information in the same way of a navigation system. In usual AR systems, the contents to be overlaid onto real space are created with 3D Computer Graphics. In most cases, such contents are newly created according to applications. However, there are many 2D videos that show how to take apart or build electric appliances and PCs, how to cook, etc. Therefore, our system employs such existing 2D videos as instructional videos. By transforming an instructional video to display, according to the user's view, and by overlaying the video onto the user's view space, the proposed system intuitively provides the user with visual guidance. In order to avoid the problem that the display of the instructional video and the user's view may be visually confused, we add various visual effects to the instructional video, such as transparency and enhancement of contours. By dividing the instructional video into sections according to the operations to be carried out in order to complete a certain task, we ensure that the user can interactively move to the next step in the instructional video after a certain operation is completed. Therefore, the user can carry on with the task at his/her own pace. In the usability test, users evaluated the use of the instructional video in our system through two tasks: a task involving building blocks and an origami task. As a result, we found that a user's visibility improves when the instructional video is transformed to display according to his/her view. Further, for the evaluation of visual effects, we can classify these effects according to the task and obtain the guideline for the use of our system as an instructional support system for performing various other tasks.

KW - H.5.1 [information interfaces and presentation]: Multimedia information systems - Artificial, augmented, and virtual realities

KW - H.5.2 [information interfaces and presentation]: User interfaces - Training, help, and documentation

UR - http://www.scopus.com/inward/record.url?scp=78651078109&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78651078109&partnerID=8YFLogxK

U2 - 10.1109/ISMAR.2010.5643554

DO - 10.1109/ISMAR.2010.5643554

M3 - Conference contribution

AN - SCOPUS:78651078109

SN - 9781424493449

SP - 83

EP - 90

BT - 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology, ISMAR 2010 - Proceedings

ER -