CheekInput: Turning your cheek into an input surface by embedded optical sensors on a head-mounted display

Koki Yamashita, Takashi Kikuchi, Katsutoshi Masai, Maki Sugimoto, Bruce H. Thomas, Yuta Sugiura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

In this paper, we propose a novel technology called "CheekInput" with a head-mounted display (HMD) that senses touch gestures by detecting skin deformation. We attached multiple photo-reflective sensors onto the bottom front frame of the HMD. Since these sensors measure the distance between the frame and cheeks, our system is able to detect the deformation of a cheek when the skin surface is touched by fingers. Our system uses a Support Vector Machine to determine the gestures: pushing face up and down, left and right. We combined these 4 directional gestures for each cheek to extend 16 possible gestures. To evaluate the accuracy of the gesture detection, we conducted a user study. The results revealed that CheekInput achieved 80.45 % recognition accuracy when gestures were made by touching both cheeks with both hands, and 74.58 % when by touching both cheeks with one hand.

Original languageEnglish
Title of host publicationProceedings - VRST 2017
Subtitle of host publication23rd ACM Conference on Virtual Reality Software and Technology
PublisherAssociation for Computing Machinery
VolumePart F131944
ISBN (Electronic)9781450355483
DOIs
Publication statusPublished - 2017 Nov 8
Event23rd ACM Conference on Virtual Reality Software and Technology, VRST 2017 - Gothenburg, Sweden
Duration: 2017 Nov 82017 Nov 10

Other

Other23rd ACM Conference on Virtual Reality Software and Technology, VRST 2017
CountrySweden
CityGothenburg
Period17/11/817/11/10

    Fingerprint

Keywords

  • OST-HMD
  • Photo-reflective sensor
  • Skin interface

ASJC Scopus subject areas

  • Software

Cite this

Yamashita, K., Kikuchi, T., Masai, K., Sugimoto, M., Thomas, B. H., & Sugiura, Y. (2017). CheekInput: Turning your cheek into an input surface by embedded optical sensors on a head-mounted display. In Proceedings - VRST 2017: 23rd ACM Conference on Virtual Reality Software and Technology (Vol. Part F131944). [a19] Association for Computing Machinery. https://doi.org/10.1145/3139131.3139146