Capture, recognition, and visualization of human semantic interactions in meetings

Zhiwen Yu, Zhiyong Yu, Hideki Aoyama, Motoyuki Ozeki, Yuichi Nakamura

研究成果: Conference contribution

20 被引用数 (Scopus)

抄録

Human interaction is one of the most important characteristics of group social dynamics in meetings. In this paper, we propose an approach for capture, recognition, and visualization of human interactions. Unlike physical interactions (e.g., turn-taking and addressing), the human interactions considered here are incorporated with semantics, i.e., user intention or attitude toward a topic. We adopt a collaborative approach for capturing interactions by employing multiple sensors, such as video cameras, microphones, and motion sensors. A multimodal method is proposed for interaction recognition based on a variety of contexts, including head gestures, attention from others, speech tone, speaking time, interaction occasion (spontaneous or reactive), and information about the previous interaction. A support vector machines (SVM) classifier is used to classify human interaction based on these features. A graphical user interface called MMBrowser is presented for interaction visualization. Experimental results have shown the effectiveness of our approach.

本文言語English
ホスト出版物のタイトル2010 IEEE International Conference on Pervasive Computing and Communications, PerCom 2010
出版社IEEE Computer Society
ページ107-115
ページ数9
ISBN(印刷版)9781424453290
DOI
出版ステータスPublished - 2010
外部発表はい
イベント8th IEEE International Conference on Pervasive Computing and Communications, PerCom 2010 - Mannheim, Germany
継続期間: 2010 3 292010 4 2

出版物シリーズ

名前2010 IEEE International Conference on Pervasive Computing and Communications, PerCom 2010

Other

Other8th IEEE International Conference on Pervasive Computing and Communications, PerCom 2010
CountryGermany
CityMannheim
Period10/3/2910/4/2

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Software
  • Theoretical Computer Science

フィンガープリント 「Capture, recognition, and visualization of human semantic interactions in meetings」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル