Evaluation of facial expressions as an interaction mechanism and their impact on affect, workload and usability in an AR game

Alan Transon, Adrien Verhulst, Jean Marie Normand, Guillaume Moreau, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

With the recent development of Head Mounted Display (HMD) for Virtual Reality (VR) allowing to track and recognize user's Facial Expression (FE)s in real-time, we investigated the impact that the use of FEs as an action-trigger input mechanism (e.g. a FE mapped to a single action) has on our emotional state; as well as their workload and usability compared to the use of a controller button. We developed an Augmented Reality (AR)-based memory card where the users select virtual cards using a wand and flip them using either a FE (smiling; frowning) or a Xbox controller button. The users were separated into three groups: (1) flipping the card with a smile (n = 10); (2) flipping the card with a frown (n = 8) and (3) flipping the cards with the Xbox controller button (n = 11). We did not see any significant differences between our groups in: (i) the positive and negative affect of the participants and (ii) the reported workload and usability, thus highlighting that the FEs could be used inside a HMD in the same way as a controller button.

Original languageEnglish
Title of host publicationProceedings of the 2017 23rd International Conference on Virtual Systems and Multimedia, VSMM 2017
EditorsAlonzo Addison, Lizbeth Goodman, Alonzo Addison
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-8
Number of pages8
ISBN (Electronic)9781538644935
DOIs
Publication statusPublished - 2018 Apr 24
Event23rd International Conference on Virtual Systems and Multimedia, VSMM 2017 - Dublin, Ireland
Duration: 2017 Oct 312017 Nov 4

Publication series

NameProceedings of the 2017 23rd International Conference on Virtual Systems and Multimedia, VSMM 2017
Volume2018-January

Other

Other23rd International Conference on Virtual Systems and Multimedia, VSMM 2017
Country/TerritoryIreland
CityDublin
Period17/10/3117/11/4

Keywords

  • Augmented Reality
  • Facial Expressions
  • Human computer interaction

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Media Technology
  • Modelling and Simulation

Fingerprint

Dive into the research topics of 'Evaluation of facial expressions as an interaction mechanism and their impact on affect, workload and usability in an AR game'. Together they form a unique fingerprint.

Cite this