FacialPen: Using Facial Detection to Augment Pen-Based Interaction

Xinrui Fang, Chengshuo Xia, Yuta Sugiura

研究成果: Conference contribution

抄録

Pen-based interactions have been ubiquitously adopted on mobile and stationary devices, but the usability can be further augmented through the use of advanced techniques. In this work, we propose FacialPen, a prototype that uses facial gestures to trigger commands for pen-based manipulation. In our prototype, a fisheye camera is mounted to the end of a stylus that provides a broad view from which to capture the human face. We facilitated an elicitation study to identify natural and user-defined gestures for interactions with facial expressions. Different gestures can be further discerned via face detection and a classification pipeline. We designed a sketching demonstration application to explore usage scenarios and evaluated the effectiveness of FacialPen through a qualitative study. The user study posits that FacialPen supports efficiency by reducing screen widgets, enabling the continuity of creation work and liberating the user's stylus holding postures when switching sketch functions.

本文言語English
ホスト出版物のタイトル5th Asian CHI Symposium 2021
編集者Josh B. Tedjasaputra, Briane Paul V. Samson, Masitah Ghazali, Eunice Sari, Eunice Sari, Sayan Sarcar, Dilrukshi Gamage, Yohannes Kurniawan
出版社Association for Computing Machinery, Inc
ページ1-8
ページ数8
ISBN(電子版)9781450382038
DOI
出版ステータスPublished - 2021 5月 8
イベント5th Asian CHI Symposium 2021 - Virtual, Online, Japan
継続期間: 2021 5月 72021 5月 8

出版物シリーズ

名前5th Asian CHI Symposium 2021

Conference

Conference5th Asian CHI Symposium 2021
国/地域Japan
CityVirtual, Online
Period21/5/721/5/8

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • 人間とコンピュータの相互作用
  • 情報システム
  • ソフトウェア

フィンガープリント

「FacialPen: Using Facial Detection to Augment Pen-Based Interaction」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル