HaptoMime: Mid-air haptic interaction with a floating virtual screen

Yasuaki Monnai; Keisuke Hasegawa; Masahiro Fujiwara; Kazuma Yoshino; Seki Inoue; Hiroyuki Shinoda

doi:10.1145/2642918.2647407

HaptoMime: Mid-air haptic interaction with a floating virtual screen

Yasuaki Monnai, Keisuke Hasegawa, Masahiro Fujiwara, Kazuma Yoshino, Seki Inoue, Hiroyuki Shinoda

Department of Applied Physics and Physico-Informatics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

64 Citations (Scopus)

Abstract

We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.

Original language	English
Title of host publication	UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology
Publisher	Association for Computing Machinery, Inc
Pages	663-668
Number of pages	6
ISBN (Electronic)	9781450330695
DOIs	https://doi.org/10.1145/2642918.2647407
Publication status	Published - 2014 Oct 5
Event	27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014 - Honolulu, United States Duration: 2014 Oct 5 → 2014 Oct 8

Publication series

Name	UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

Other

Other	27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014
Country	United States
City	Honolulu
Period	14/10/5 → 14/10/8

Fingerprint

Keywords

Aerial imaging
Mid-air interaction
Tactile feedback

ASJC Scopus subject areas

Software
Human-Computer Interaction

Cite this

Monnai, Y., Hasegawa, K., Fujiwara, M., Yoshino, K., Inoue, S., & Shinoda, H. (2014). HaptoMime: Mid-air haptic interaction with a floating virtual screen. In UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (pp. 663-668). (UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/2642918.2647407

HaptoMime : Mid-air haptic interaction with a floating virtual screen. / Monnai, Yasuaki; Hasegawa, Keisuke; Fujiwara, Masahiro; Yoshino, Kazuma; Inoue, Seki; Shinoda, Hiroyuki.

UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2014. p. 663-668 (UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Monnai, Y, Hasegawa, K, Fujiwara, M, Yoshino, K, Inoue, S & Shinoda, H 2014, HaptoMime: Mid-air haptic interaction with a floating virtual screen. in UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery, Inc, pp. 663-668, 27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014, Honolulu, United States, 14/10/5. https://doi.org/10.1145/2642918.2647407

Monnai Y, Hasegawa K, Fujiwara M, Yoshino K, Inoue S, Shinoda H. HaptoMime: Mid-air haptic interaction with a floating virtual screen. In UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc. 2014. p. 663-668. (UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology). https://doi.org/10.1145/2642918.2647407

Monnai, Yasuaki ; Hasegawa, Keisuke ; Fujiwara, Masahiro ; Yoshino, Kazuma ; Inoue, Seki ; Shinoda, Hiroyuki. / HaptoMime : Mid-air haptic interaction with a floating virtual screen. UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery, Inc, 2014. pp. 663-668 (UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology).

@inproceedings{0bccb2b2c0e846c09037aae18be58c63,

title = "HaptoMime: Mid-air haptic interaction with a floating virtual screen",

abstract = "We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.",

keywords = "Aerial imaging, Mid-air interaction, Tactile feedback",

author = "Yasuaki Monnai and Keisuke Hasegawa and Masahiro Fujiwara and Kazuma Yoshino and Seki Inoue and Hiroyuki Shinoda",

year = "2014",

month = oct

day = "5",

doi = "10.1145/2642918.2647407",

language = "English",

series = "UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology",

publisher = "Association for Computing Machinery, Inc",

pages = "663--668",

booktitle = "UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology",

note = "27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014 ; Conference date: 05-10-2014 Through 08-10-2014",

}

TY - GEN

T1 - HaptoMime

T2 - 27th Annual ACM Symposium on User Interface Software and Technology, UIST 2014

AU - Monnai, Yasuaki

AU - Hasegawa, Keisuke

AU - Fujiwara, Masahiro

AU - Yoshino, Kazuma

AU - Inoue, Seki

AU - Shinoda, Hiroyuki

PY - 2014/10/5

Y1 - 2014/10/5

N2 - We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.

AB - We present HaptoMime, a mid-air interaction system that allows users to touch a floating virtual screen with hands-free tactile feedback. Floating images formed by tailored light beams are inherently lacking in tactile feedback. Here we propose a method to superpose hands-free tactile feedback on such a floating image using ultrasound. By tracking a fingertip with an electronically steerable ultrasonic beam, the fingertip encounters a mechanical force consistent with the floating image. We demonstrate and characterize the proposed transmission scheme and discuss promising applications with an emphasis that it helps us 'pantomime' in mid-air.

KW - Aerial imaging

KW - Mid-air interaction

KW - Tactile feedback

UR - http://www.scopus.com/inward/record.url?scp=84912050145&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84912050145&partnerID=8YFLogxK

U2 - 10.1145/2642918.2647407

DO - 10.1145/2642918.2647407

M3 - Conference contribution

AN - SCOPUS:84912050145

T3 - UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

SP - 663

EP - 668

BT - UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

PB - Association for Computing Machinery, Inc

Y2 - 5 October 2014 through 8 October 2014

ER -

Access to Document

10.1145/2642918.2647407