Masktrap: Designing and Identifying Gestures to Transform Mask Strap into an Input Interface

Takumi Yamamoto, Katsutoshi Masai, Anusha Withana, Yuta Sugiura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Embedding technology into day-to-day wearables and creating smart devices such as smartwatches and smart-glasses has been a growing area of interest. In this paper, we explore the interaction around face masks, a common accessory worn by many to prevent the spread of infectious diseases. Particularly, we propose a method of using the straps of a face mask as an input medium. We identified a set of plausible gestures on mask straps through an elicitation study (N = 20), in which the participants proposed different gestures for a given referent. We then developed a prototype to identify the gestures performed on the mask straps and present the recognition accuracy from a user study with eight participants. Our results show the system achieves 93.07% classification accuracy for 12 gestures.

Original languageEnglish
Title of host publicationIUI 2023 - Proceedings of the 28th International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
Pages762-775
Number of pages14
ISBN (Electronic)9798400701061
DOIs
Publication statusPublished - 2023 Mar 27
Event28th International Conference on Intelligent User Interfaces, IUI 2023 - Sydney, Australia
Duration: 2023 Mar 272023 Mar 31

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI

Conference

Conference28th International Conference on Intelligent User Interfaces, IUI 2023
Country/TerritoryAustralia
CitySydney
Period23/3/2723/3/31

Keywords

  • Mask
  • Strings
  • User Elicitation Study
  • Wearable Device

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Masktrap: Designing and Identifying Gestures to Transform Mask Strap into an Input Interface'. Together they form a unique fingerprint.

Cite this