Enforced telexistence: Teleoperating using photorealistic virtual body and haptic feedback

M. H D Yamen Saraiji, Charith Lasantha Fernando, Yusuke Mizushina, Youichi Kamiyama, Kouta Minamizawa, Susumu Tachi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Telexistence [Tachi 2010] systems require physical limbs for remote object manipulation [Fernando et al. 2012]. Having arms and hands synchronized with voluntary movements allows the user to feel robot's body as his body through visual, and haptic sensation. In this method, we introduce a novel technique that provides virtual arms for existing telexistence systems that does not have physical arms. Previous works [Mine et al. 1997; Poupyrev et al. 1998; Nedel et al. 2003] involved the study of using virtual representation of user hands in virtual environments for interactions. In this work, the virtual arms serves for several interactions in a physical remote environment, and most importantly they provide the user the sense of existence in that remote environment. These superimposed virtual arms follows the user's real-time arm movements and reacts to the dynamic lighting of real environment providing photorealistic rendering adapting to remote place lighting. Thus, it allows the user to have an experience of embodied enforcement towards the remote environment. Furthermore, these virtual arms can be extended to touch and feel unreachable remote objects, and to grab a functional virtual copy of a physical instance where device control is possible. This method does not only allow the user to experience a non-existing arm in telexistence, but also gives the ability to enforce remote environment in various ways.

Original languageEnglish
Title of host publicationSIGGRAPH Asia 2014 Emerging Technologies, SA 2014
PublisherAssociation for Computing Machinery, Inc
ISBN (Print)9781450319553
DOIs
Publication statusPublished - 2014 Nov 24
EventSIGGRAPH Asia 2014 Emerging Technologies, SA 2014 - Shenzhen, China
Duration: 2014 Dec 32014 Dec 6

Other

OtherSIGGRAPH Asia 2014 Emerging Technologies, SA 2014
CountryChina
CityShenzhen
Period14/12/314/12/6

Fingerprint

Lighting
Feedback
Virtual reality
Robots

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Yamen Saraiji, M. H. D., Fernando, C. L., Mizushina, Y., Kamiyama, Y., Minamizawa, K., & Tachi, S. (2014). Enforced telexistence: Teleoperating using photorealistic virtual body and haptic feedback. In SIGGRAPH Asia 2014 Emerging Technologies, SA 2014 Association for Computing Machinery, Inc. https://doi.org/10.1145/2669047.2669048

Enforced telexistence : Teleoperating using photorealistic virtual body and haptic feedback. / Yamen Saraiji, M. H D; Fernando, Charith Lasantha; Mizushina, Yusuke; Kamiyama, Youichi; Minamizawa, Kouta; Tachi, Susumu.

SIGGRAPH Asia 2014 Emerging Technologies, SA 2014. Association for Computing Machinery, Inc, 2014.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yamen Saraiji, MHD, Fernando, CL, Mizushina, Y, Kamiyama, Y, Minamizawa, K & Tachi, S 2014, Enforced telexistence: Teleoperating using photorealistic virtual body and haptic feedback. in SIGGRAPH Asia 2014 Emerging Technologies, SA 2014. Association for Computing Machinery, Inc, SIGGRAPH Asia 2014 Emerging Technologies, SA 2014, Shenzhen, China, 14/12/3. https://doi.org/10.1145/2669047.2669048
Yamen Saraiji MHD, Fernando CL, Mizushina Y, Kamiyama Y, Minamizawa K, Tachi S. Enforced telexistence: Teleoperating using photorealistic virtual body and haptic feedback. In SIGGRAPH Asia 2014 Emerging Technologies, SA 2014. Association for Computing Machinery, Inc. 2014 https://doi.org/10.1145/2669047.2669048
Yamen Saraiji, M. H D ; Fernando, Charith Lasantha ; Mizushina, Yusuke ; Kamiyama, Youichi ; Minamizawa, Kouta ; Tachi, Susumu. / Enforced telexistence : Teleoperating using photorealistic virtual body and haptic feedback. SIGGRAPH Asia 2014 Emerging Technologies, SA 2014. Association for Computing Machinery, Inc, 2014.
@inproceedings{329ebf7a174c44538f8c813f72186dbd,
title = "Enforced telexistence: Teleoperating using photorealistic virtual body and haptic feedback",
abstract = "Telexistence [Tachi 2010] systems require physical limbs for remote object manipulation [Fernando et al. 2012]. Having arms and hands synchronized with voluntary movements allows the user to feel robot's body as his body through visual, and haptic sensation. In this method, we introduce a novel technique that provides virtual arms for existing telexistence systems that does not have physical arms. Previous works [Mine et al. 1997; Poupyrev et al. 1998; Nedel et al. 2003] involved the study of using virtual representation of user hands in virtual environments for interactions. In this work, the virtual arms serves for several interactions in a physical remote environment, and most importantly they provide the user the sense of existence in that remote environment. These superimposed virtual arms follows the user's real-time arm movements and reacts to the dynamic lighting of real environment providing photorealistic rendering adapting to remote place lighting. Thus, it allows the user to have an experience of embodied enforcement towards the remote environment. Furthermore, these virtual arms can be extended to touch and feel unreachable remote objects, and to grab a functional virtual copy of a physical instance where device control is possible. This method does not only allow the user to experience a non-existing arm in telexistence, but also gives the ability to enforce remote environment in various ways.",
author = "{Yamen Saraiji}, {M. H D} and Fernando, {Charith Lasantha} and Yusuke Mizushina and Youichi Kamiyama and Kouta Minamizawa and Susumu Tachi",
year = "2014",
month = "11",
day = "24",
doi = "10.1145/2669047.2669048",
language = "English",
isbn = "9781450319553",
booktitle = "SIGGRAPH Asia 2014 Emerging Technologies, SA 2014",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - Enforced telexistence

T2 - Teleoperating using photorealistic virtual body and haptic feedback

AU - Yamen Saraiji, M. H D

AU - Fernando, Charith Lasantha

AU - Mizushina, Yusuke

AU - Kamiyama, Youichi

AU - Minamizawa, Kouta

AU - Tachi, Susumu

PY - 2014/11/24

Y1 - 2014/11/24

N2 - Telexistence [Tachi 2010] systems require physical limbs for remote object manipulation [Fernando et al. 2012]. Having arms and hands synchronized with voluntary movements allows the user to feel robot's body as his body through visual, and haptic sensation. In this method, we introduce a novel technique that provides virtual arms for existing telexistence systems that does not have physical arms. Previous works [Mine et al. 1997; Poupyrev et al. 1998; Nedel et al. 2003] involved the study of using virtual representation of user hands in virtual environments for interactions. In this work, the virtual arms serves for several interactions in a physical remote environment, and most importantly they provide the user the sense of existence in that remote environment. These superimposed virtual arms follows the user's real-time arm movements and reacts to the dynamic lighting of real environment providing photorealistic rendering adapting to remote place lighting. Thus, it allows the user to have an experience of embodied enforcement towards the remote environment. Furthermore, these virtual arms can be extended to touch and feel unreachable remote objects, and to grab a functional virtual copy of a physical instance where device control is possible. This method does not only allow the user to experience a non-existing arm in telexistence, but also gives the ability to enforce remote environment in various ways.

AB - Telexistence [Tachi 2010] systems require physical limbs for remote object manipulation [Fernando et al. 2012]. Having arms and hands synchronized with voluntary movements allows the user to feel robot's body as his body through visual, and haptic sensation. In this method, we introduce a novel technique that provides virtual arms for existing telexistence systems that does not have physical arms. Previous works [Mine et al. 1997; Poupyrev et al. 1998; Nedel et al. 2003] involved the study of using virtual representation of user hands in virtual environments for interactions. In this work, the virtual arms serves for several interactions in a physical remote environment, and most importantly they provide the user the sense of existence in that remote environment. These superimposed virtual arms follows the user's real-time arm movements and reacts to the dynamic lighting of real environment providing photorealistic rendering adapting to remote place lighting. Thus, it allows the user to have an experience of embodied enforcement towards the remote environment. Furthermore, these virtual arms can be extended to touch and feel unreachable remote objects, and to grab a functional virtual copy of a physical instance where device control is possible. This method does not only allow the user to experience a non-existing arm in telexistence, but also gives the ability to enforce remote environment in various ways.

UR - http://www.scopus.com/inward/record.url?scp=84926250965&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84926250965&partnerID=8YFLogxK

U2 - 10.1145/2669047.2669048

DO - 10.1145/2669047.2669048

M3 - Conference contribution

AN - SCOPUS:84926250965

SN - 9781450319553

BT - SIGGRAPH Asia 2014 Emerging Technologies, SA 2014

PB - Association for Computing Machinery, Inc

ER -