MultiSoma: Motor and Gaze Analysis on Distributed Embodiment With Synchronized Behavior and Perception

Reiji Miura, Shunichi Kasahara, Michiteru Kitazaki, Adrien Verhulst, Masahiko Inami, Maki Sugimoto

Research output: Contribution to journalArticlepeer-review

Abstract

Human behavior and perception are optimized for a single body. Yet, the human brain has plasticity, which allows us to extend our body schema. By utilizing technology like robotics or virtual reality (VR), we can modify our body parts or even add a new body to our own while retaining control over these parts. However, the update of body cognition when controlling multiple bodies has not been well examined. In this study, we explore the task performance and body cognition of humans when they have multiple full bodies as an extended embodiment. Our experimental system allows a participant to control up to four bodies at the same time and perceive sensory information from them. The participant experiences synchronizing behavior and vision perception in a virtual environment. We set up three tasks for multiple bodies and evaluated the cognition of these bodies with their gazing information, task performances, and subjective ratings. We found that humans can have the sense of body ownership and agency for each body when controlling multiple bodies simultaneously. Furthermore, it was observed that people manipulate multiple bodies by actively switching their attention in a static environment and passively switching their attention in a dynamic environment. Distributed embodiment has the potential to extend human behavior in cooperative work, parallel work, group behavior, and so on.

Original languageEnglish
Article number788014
JournalFrontiers in Computer Science
Volume4
DOIs
Publication statusPublished - 2022 May 31

Keywords

  • augmented human
  • embodiment
  • gaze analysis
  • multiple bodies
  • virtual reality

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction
  • Computer Science (miscellaneous)

Fingerprint

Dive into the research topics of 'MultiSoma: Motor and Gaze Analysis on Distributed Embodiment With Synchronized Behavior and Perception'. Together they form a unique fingerprint.

Cite this