Assessing hands-free interactions for VR using eye gaze and electromyography

Yun Suen Pai, Tilman Dingler, Kai Steven Kunze

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

With the increasing popularity of virtual reality (VR) technologies, more efforts have been going into developing new input methods. While physical controllers are widely used, more novel techniques, such as eye tracking, are now commercially available. In our work, we investigate the use of physiological signals as input to enhance VR experiences. We present a system using gaze tracking and electromyography on a user’s forearm to make selection tasks in virtual spaces more efficient. In a study with 16 participants, we compared five different input techniques using a Fitts’ law task: Using gaze tracking for cursor movement in combination with forearm contractions for making selections was superior to using an HTC Vive controller, Xbox gamepad, dwelling time, and eye-gaze dwelling time. To explore application scenarios and collect qualitative feedback, we further developed and evaluated a game with our input technique. Our findings inform the design of applications that use eye-gaze tracking and forearm muscle movements for effective user input in VR.

Original languageEnglish
JournalVirtual Reality
DOIs
Publication statusAccepted/In press - 2018 Jan 1

Fingerprint

Electromyography
Virtual reality
Controllers
Muscle
Feedback

Keywords

  • Electromyography
  • Eye gaze
  • Physiological sensing
  • Virtual reality

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Cite this

Assessing hands-free interactions for VR using eye gaze and electromyography. / Pai, Yun Suen; Dingler, Tilman; Kunze, Kai Steven.

In: Virtual Reality, 01.01.2018.

Research output: Contribution to journalArticle

@article{2b6b15c0747842de8912099e21e2b863,
title = "Assessing hands-free interactions for VR using eye gaze and electromyography",
abstract = "With the increasing popularity of virtual reality (VR) technologies, more efforts have been going into developing new input methods. While physical controllers are widely used, more novel techniques, such as eye tracking, are now commercially available. In our work, we investigate the use of physiological signals as input to enhance VR experiences. We present a system using gaze tracking and electromyography on a user’s forearm to make selection tasks in virtual spaces more efficient. In a study with 16 participants, we compared five different input techniques using a Fitts’ law task: Using gaze tracking for cursor movement in combination with forearm contractions for making selections was superior to using an HTC Vive controller, Xbox gamepad, dwelling time, and eye-gaze dwelling time. To explore application scenarios and collect qualitative feedback, we further developed and evaluated a game with our input technique. Our findings inform the design of applications that use eye-gaze tracking and forearm muscle movements for effective user input in VR.",
keywords = "Electromyography, Eye gaze, Physiological sensing, Virtual reality",
author = "Pai, {Yun Suen} and Tilman Dingler and Kunze, {Kai Steven}",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/s10055-018-0371-2",
language = "English",
journal = "Virtual Reality",
issn = "1359-4338",
publisher = "Springer London",

}

TY - JOUR

T1 - Assessing hands-free interactions for VR using eye gaze and electromyography

AU - Pai, Yun Suen

AU - Dingler, Tilman

AU - Kunze, Kai Steven

PY - 2018/1/1

Y1 - 2018/1/1

N2 - With the increasing popularity of virtual reality (VR) technologies, more efforts have been going into developing new input methods. While physical controllers are widely used, more novel techniques, such as eye tracking, are now commercially available. In our work, we investigate the use of physiological signals as input to enhance VR experiences. We present a system using gaze tracking and electromyography on a user’s forearm to make selection tasks in virtual spaces more efficient. In a study with 16 participants, we compared five different input techniques using a Fitts’ law task: Using gaze tracking for cursor movement in combination with forearm contractions for making selections was superior to using an HTC Vive controller, Xbox gamepad, dwelling time, and eye-gaze dwelling time. To explore application scenarios and collect qualitative feedback, we further developed and evaluated a game with our input technique. Our findings inform the design of applications that use eye-gaze tracking and forearm muscle movements for effective user input in VR.

AB - With the increasing popularity of virtual reality (VR) technologies, more efforts have been going into developing new input methods. While physical controllers are widely used, more novel techniques, such as eye tracking, are now commercially available. In our work, we investigate the use of physiological signals as input to enhance VR experiences. We present a system using gaze tracking and electromyography on a user’s forearm to make selection tasks in virtual spaces more efficient. In a study with 16 participants, we compared five different input techniques using a Fitts’ law task: Using gaze tracking for cursor movement in combination with forearm contractions for making selections was superior to using an HTC Vive controller, Xbox gamepad, dwelling time, and eye-gaze dwelling time. To explore application scenarios and collect qualitative feedback, we further developed and evaluated a game with our input technique. Our findings inform the design of applications that use eye-gaze tracking and forearm muscle movements for effective user input in VR.

KW - Electromyography

KW - Eye gaze

KW - Physiological sensing

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85056830523&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056830523&partnerID=8YFLogxK

U2 - 10.1007/s10055-018-0371-2

DO - 10.1007/s10055-018-0371-2

M3 - Article

JO - Virtual Reality

JF - Virtual Reality

SN - 1359-4338

ER -