Sentiment pen: recognizing emotional context based on handwriting features

Jiawen Han, George Chernyshov, Dingding Zheng, Peizhong Gao, Takuji Narumi, Katrin Wolf, Kai Kunze

研究成果: Conference contribution

1 被引用数 (Scopus)


In this paper, we discuss the assessment of the emotional state of the user from digitized handwriting for implicit human-computer interaction. The proposed concept exemplifies how a digital system could recognize the emotional context of the interaction.We discuss our approach to emotion recognition and the underlying neurophysiological mechanisms. To verify the viability of our approach, we have conducted a series of tests where participants were asked to perform simple writing tasks after being exposed to a series of emotionally-stimulating video clips from EMDB[6], one set of four clips per each quadrant on the circumplex model of emotion[28]. The user-independent Support Vector Classifier (SVC) built using the recorded data shows up to 66% accuracy for certain types of writing tasks for 1 in 4 classification (1. High Valence, High Arousal; 2. High Valence, Low Arousal; 3. Low Valence, High Arousal; 4. Low Valence, Low Arousal). In the same conditions, a user-dependent classifier reaches an average of 70% accuracy across all 12 study participants. While future work is required to improve the classification rate, this work should be seen as proof-of-concept for emotion assessment of users while handwriting aiming to motivate research on implicit interaction while writing to enable emotion-sensitivity in mobile and ubiquitous computing.

ホスト出版物のタイトルProceedings of the 10th Augmented Human International Conference, AH 2019
出版ステータスPublished - 2019 3 11
イベント10th Augmented Human International Conference, AH 2019 - Reims, France
継続期間: 2019 3 112019 3 12


名前PervasiveHealth: Pervasive Computing Technologies for Healthcare


Conference10th Augmented Human International Conference, AH 2019

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • 情報システム
  • コンピュータ サイエンスの応用
  • 健康情報学


「Sentiment pen: recognizing emotional context based on handwriting features」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。