FacialPen: Using Facial Detection to Augment Pen-Based Interaction

Xinrui Fang, Chengshuo Xia, Yuta Sugiura

研究成果: Conference contribution


Pen-based interactions have been ubiquitously adopted on mobile and stationary devices, but the usability can be further augmented through the use of advanced techniques. In this work, we propose FacialPen, a prototype that uses facial gestures to trigger commands for pen-based manipulation. In our prototype, a fisheye camera is mounted to the end of a stylus that provides a broad view from which to capture the human face. We facilitated an elicitation study to identify natural and user-defined gestures for interactions with facial expressions. Different gestures can be further discerned via face detection and a classification pipeline. We designed a sketching demonstration application to explore usage scenarios and evaluated the effectiveness of FacialPen through a qualitative study. The user study posits that FacialPen supports efficiency by reducing screen widgets, enabling the continuity of creation work and liberating the user's stylus holding postures when switching sketch functions.

ホスト出版物のタイトル5th Asian CHI Symposium 2021
編集者Josh B. Tedjasaputra, Briane Paul V. Samson, Masitah Ghazali, Eunice Sari, Eunice Sari, Sayan Sarcar, Dilrukshi Gamage, Yohannes Kurniawan
出版社Association for Computing Machinery, Inc
出版ステータスPublished - 2021 5月 8
イベント5th Asian CHI Symposium 2021 - Virtual, Online, Japan
継続期間: 2021 5月 72021 5月 8


名前5th Asian CHI Symposium 2021


Conference5th Asian CHI Symposium 2021
CityVirtual, Online

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • 人間とコンピュータの相互作用
  • 情報システム
  • ソフトウェア


「FacialPen: Using Facial Detection to Augment Pen-Based Interaction」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。