Layered telepresence: Simultaneous multi presence experience using eye gaze based perceptual awareness blending

M. H D Yamen Saraiji, Shota Sugimoto, Charith Lasantha Fernando, Kouta Minamizawa, Susumu Tachi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We propose "Layered Telepresence", a novel method of experiencing simultaneous multi-presence. Users eye gaze and perceptual awareness are blended with real-time audio-visual information received from multiple telepresence robots. The system arranges audio-visual information received through multiple robots into a priority-driven layered stack. A weighted feature map was created based on the objects recognized for each layer, using image-processing techniques, and pushes the most weighted layer around the users gaze in to the foreground. All other layers are pushed back to the background providing an artificial depth-of-field effect. The proposed method not only works with robots, but also each layer could represent any audio-visual content, such as video see-through HMD, television screen or even your PC screen enabling true multitasking.

Original languageEnglish
Title of host publicationACM SIGGRAPH 2016 Emerging Technologies, SIGGRAPH 2016
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450343725
DOIs
Publication statusPublished - 2016 Jul 24
EventACM International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2016 - Anaheim, United States
Duration: 2016 Jul 242016 Jul 28

Other

OtherACM International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2016
CountryUnited States
CityAnaheim
Period16/7/2416/7/28

Keywords

  • Depth of field
  • Eye gaze
  • Perceptual awareness blending
  • Peripheral vision
  • Simultaneous multi presence

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Layered telepresence: Simultaneous multi presence experience using eye gaze based perceptual awareness blending'. Together they form a unique fingerprint.

  • Cite this

    Saraiji, M. H. D. Y., Sugimoto, S., Fernando, C. L., Minamizawa, K., & Tachi, S. (2016). Layered telepresence: Simultaneous multi presence experience using eye gaze based perceptual awareness blending. In ACM SIGGRAPH 2016 Emerging Technologies, SIGGRAPH 2016 [2929467] Association for Computing Machinery, Inc. https://doi.org/10.1145/2929464.2929467