HaptoMime: Mid-air haptic interaction with a floating virtual screen

Yasuaki Monnai, Keisuke Hasegawa, Masahiro Fujiwara, Kazuma Yoshino, Seki Inoue, Hiroyuki Shinoda

Research output: Chapter in Book/Report/Conference proceedingConference contribution

59 Citations (Scopus)

Abstract

We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.

Original languageEnglish
Title of host publicationUIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages663-668
Number of pages6
ISBN (Print)9781450330695
DOIs
Publication statusPublished - 2014 Oct 5
Externally publishedYes
Event27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014 - Honolulu, United States
Duration: 2014 Oct 52014 Oct 8

Other

Other27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014
CountryUnited States
CityHonolulu
Period14/10/514/10/8

Fingerprint

Feedback
Air
Ultrasonics

Keywords

  • Aerial imaging
  • Mid-air interaction
  • Tactile feedback

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Monnai, Y., Hasegawa, K., Fujiwara, M., Yoshino, K., Inoue, S., & Shinoda, H. (2014). HaptoMime: Mid-air haptic interaction with a floating virtual screen. In UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (pp. 663-668). Association for Computing Machinery, Inc. https://doi.org/10.1145/2642918.2647407

HaptoMime : Mid-air haptic interaction with a floating virtual screen. / Monnai, Yasuaki; Hasegawa, Keisuke; Fujiwara, Masahiro; Yoshino, Kazuma; Inoue, Seki; Shinoda, Hiroyuki.

UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2014. p. 663-668.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Monnai, Y, Hasegawa, K, Fujiwara, M, Yoshino, K, Inoue, S & Shinoda, H 2014, HaptoMime: Mid-air haptic interaction with a floating virtual screen. in UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, pp. 663-668, 27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014, Honolulu, United States, 14/10/5. https://doi.org/10.1145/2642918.2647407
Monnai Y, Hasegawa K, Fujiwara M, Yoshino K, Inoue S, Shinoda H. HaptoMime: Mid-air haptic interaction with a floating virtual screen. In UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc. 2014. p. 663-668 https://doi.org/10.1145/2642918.2647407
Monnai, Yasuaki ; Hasegawa, Keisuke ; Fujiwara, Masahiro ; Yoshino, Kazuma ; Inoue, Seki ; Shinoda, Hiroyuki. / HaptoMime : Mid-air haptic interaction with a floating virtual screen. UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2014. pp. 663-668
@inproceedings{0bccb2b2c0e846c09037aae18be58c63,
title = "HaptoMime: Mid-air haptic interaction with a floating virtual screen",
abstract = "We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.",
keywords = "Aerial imaging, Mid-air interaction, Tactile feedback",
author = "Yasuaki Monnai and Keisuke Hasegawa and Masahiro Fujiwara and Kazuma Yoshino and Seki Inoue and Hiroyuki Shinoda",
year = "2014",
month = "10",
day = "5",
doi = "10.1145/2642918.2647407",
language = "English",
isbn = "9781450330695",
pages = "663--668",
booktitle = "UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - HaptoMime

T2 - Mid-air haptic interaction with a floating virtual screen

AU - Monnai, Yasuaki

AU - Hasegawa, Keisuke

AU - Fujiwara, Masahiro

AU - Yoshino, Kazuma

AU - Inoue, Seki

AU - Shinoda, Hiroyuki

PY - 2014/10/5

Y1 - 2014/10/5

N2 - We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.

AB - We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.

KW - Aerial imaging

KW - Mid-air interaction

KW - Tactile feedback

UR - http://www.scopus.com/inward/record.url?scp=84912050145&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84912050145&partnerID=8YFLogxK

U2 - 10.1145/2642918.2647407

DO - 10.1145/2642918.2647407

M3 - Conference contribution

AN - SCOPUS:84912050145

SN - 9781450330695

SP - 663

EP - 668

BT - UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

PB - Association for Computing Machinery, Inc

ER -