Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game

David Bannach, Oliver Amft, Kai Steven Kunze, Ernst A. Heinz, Gerhard Tröster, Paul Lukowicz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

23 Citations (Scopus)

Abstract

We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3-D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup.

Original languageEnglish
Title of host publicationProceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007
Pages32-39
Number of pages8
DOIs
Publication statusPublished - 2007
Externally publishedYes
Event2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007 - Honolulu, HI, United States
Duration: 2007 Apr 12007 Apr 5

Other

Other2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007
CountryUnited States
CityHonolulu, HI
Period07/4/107/4/5

Fingerprint

Mixed Reality
Parking
Gesture
Driver
Railroad cars
Game
Sensor
Motion
Sensors
Edutainment
3D Graphics
Gesture recognition
Gesture Recognition
Ambient Intelligence
Context-awareness
Computer applications
Gaming
Quantitative Evaluation
Appeal
Human computer interaction

Keywords

  • Game control
  • Gesture recognition
  • Immersive human-computer interaction
  • Java-3D
  • Mixed reality
  • Motion sensors
  • Wearable computing

ASJC Scopus subject areas

  • Artificial Intelligence
  • Electrical and Electronic Engineering
  • Computational Mathematics
  • Theoretical Computer Science

Cite this

Bannach, D., Amft, O., Kunze, K. S., Heinz, E. A., Tröster, G., & Lukowicz, P. (2007). Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game. In Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007 (pp. 32-39). [4219021] https://doi.org/10.1109/CIG.2007.368076

Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game. / Bannach, David; Amft, Oliver; Kunze, Kai Steven; Heinz, Ernst A.; Tröster, Gerhard; Lukowicz, Paul.

Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007. 2007. p. 32-39 4219021.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bannach, D, Amft, O, Kunze, KS, Heinz, EA, Tröster, G & Lukowicz, P 2007, Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game. in Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007., 4219021, pp. 32-39, 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007, Honolulu, HI, United States, 07/4/1. https://doi.org/10.1109/CIG.2007.368076
Bannach D, Amft O, Kunze KS, Heinz EA, Tröster G, Lukowicz P. Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game. In Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007. 2007. p. 32-39. 4219021 https://doi.org/10.1109/CIG.2007.368076
Bannach, David ; Amft, Oliver ; Kunze, Kai Steven ; Heinz, Ernst A. ; Tröster, Gerhard ; Lukowicz, Paul. / Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game. Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007. 2007. pp. 32-39
@inproceedings{f8c0f471841f481e88fbb3443975f1dc,
title = "Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game",
abstract = "We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3-D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup.",
keywords = "Game control, Gesture recognition, Immersive human-computer interaction, Java-3D, Mixed reality, Motion sensors, Wearable computing",
author = "David Bannach and Oliver Amft and Kunze, {Kai Steven} and Heinz, {Ernst A.} and Gerhard Tr{\"o}ster and Paul Lukowicz",
year = "2007",
doi = "10.1109/CIG.2007.368076",
language = "English",
isbn = "1424407095",
pages = "32--39",
booktitle = "Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007",

}

TY - GEN

T1 - Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game

AU - Bannach, David

AU - Amft, Oliver

AU - Kunze, Kai Steven

AU - Heinz, Ernst A.

AU - Tröster, Gerhard

AU - Lukowicz, Paul

PY - 2007

Y1 - 2007

N2 - We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3-D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup.

AB - We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3-D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup.

KW - Game control

KW - Gesture recognition

KW - Immersive human-computer interaction

KW - Java-3D

KW - Mixed reality

KW - Motion sensors

KW - Wearable computing

UR - http://www.scopus.com/inward/record.url?scp=34548709554&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34548709554&partnerID=8YFLogxK

U2 - 10.1109/CIG.2007.368076

DO - 10.1109/CIG.2007.368076

M3 - Conference contribution

AN - SCOPUS:34548709554

SN - 1424407095

SN - 9781424407095

SP - 32

EP - 39

BT - Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007

ER -