Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game

David Bannach, Oliver Amft, Kai S. Kunze, Ernst A. Heinz, Gerhard Tröster, Paul Lukowicz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

27 Citations (Scopus)

Abstract

We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3-D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup.

Original languageEnglish
Title of host publicationProceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007
Pages32-39
Number of pages8
DOIs
Publication statusPublished - 2007 Sep 25
Externally publishedYes
Event2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007 - Honolulu, HI, United States
Duration: 2007 Apr 12007 Apr 5

Publication series

NameProceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007

Other

Other2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007
CountryUnited States
CityHonolulu, HI
Period07/4/107/4/5

    Fingerprint

Keywords

  • Game control
  • Gesture recognition
  • Immersive human-computer interaction
  • Java-3D
  • Mixed reality
  • Motion sensors
  • Wearable computing

ASJC Scopus subject areas

  • Artificial Intelligence
  • Electrical and Electronic Engineering
  • Computational Mathematics
  • Theoretical Computer Science

Cite this

Bannach, D., Amft, O., Kunze, K. S., Heinz, E. A., Tröster, G., & Lukowicz, P. (2007). Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game. In Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007 (pp. 32-39). [4219021] (Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007). https://doi.org/10.1109/CIG.2007.368076