Capture, recognition, and visualization of human semantic interactions in meetings

Zhiwen Yu, Zhiyong Yu, Hideki Aoyama, Motoyuki Ozeki, Yuichi Nakamura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

21 Citations (Scopus)

Abstract

Human interaction is one of the most important characteristics of group social dynamics in meetings. In this paper, we propose an approach for capture, recognition, and visualization of human interactions. Unlike physical interactions (e.g., turn-taking and addressing), the human interactions considered here are incorporated with semantics, i.e., user intention or attitude toward a topic. We adopt a collaborative approach for capturing interactions by employing multiple sensors, such as video cameras, microphones, and motion sensors. A multimodal method is proposed for interaction recognition based on a variety of contexts, including head gestures, attention from others, speech tone, speaking time, interaction occasion (spontaneous or reactive), and information about the previous interaction. A support vector machines (SVM) classifier is used to classify human interaction based on these features. A graphical user interface called MMBrowser is presented for interaction visualization. Experimental results have shown the effectiveness of our approach.

Original languageEnglish
Title of host publication2010 IEEE International Conference on Pervasive Computing and Communications, PerCom 2010
PublisherIEEE Computer Society
Pages107-115
Number of pages9
ISBN (Print)9781424453290
DOIs
Publication statusPublished - 2010
Event8th IEEE International Conference on Pervasive Computing and Communications, PerCom 2010 - Mannheim, Germany
Duration: 2010 Mar 292010 Apr 2

Publication series

Name2010 IEEE International Conference on Pervasive Computing and Communications, PerCom 2010

Other

Other8th IEEE International Conference on Pervasive Computing and Communications, PerCom 2010
CountryGermany
CityMannheim
Period10/3/2910/4/2

Keywords

  • Human interaction
  • Interaction capture
  • Interaction recognition
  • Smart meeting
  • Visualization

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Software
  • Theoretical Computer Science

Fingerprint Dive into the research topics of 'Capture, recognition, and visualization of human semantic interactions in meetings'. Together they form a unique fingerprint.

  • Cite this

    Yu, Z., Yu, Z., Aoyama, H., Ozeki, M., & Nakamura, Y. (2010). Capture, recognition, and visualization of human semantic interactions in meetings. In 2010 IEEE International Conference on Pervasive Computing and Communications, PerCom 2010 (pp. 107-115). [5466987] (2010 IEEE International Conference on Pervasive Computing and Communications, PerCom 2010). IEEE Computer Society. https://doi.org/10.1109/percom.2010.5466987