ReallifeEngine: A Mixed Reality-Based Visual Programming System for SmartHomes

Ryohei Suzuki, Katsutoshi Masai, Maki Sugimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The conveniences experienced by society have tremendously improved with the development of the Internet of Things (IoT). Among the affordances stemming from this innovation is an IoT concept called the SmartHome, which is already spreading even in general households. Despite this proliferation, however, ordinary users experience difficulty in performing the complex control and automation of IoT devices, thereby impeding their full exploitation of IoT benefits. These problems highlight the need for a system that enables general users to easily manipulate IoT devices. Correspondingly, this study constructed a visual programming system that facilitates IoT device operation. The system, which was developed on the basis of data obtained from various sensors in a SmartHome, employs mixed reality(MR) in enhancing the visualization of various data, eases the understanding of the positional relationship among devices, and smoothens the checking of execution results. We conducted an evaluation experiment wherein eight users were asked to test the proposed system, and we verified its usefulness on the basis of the time elapsed until the participants completed the programming of diverse IoT devices and a questionnaire intended to derive their subjective assessments. The result indicates that the proposed system makes it easy to understand the correspondence between the real world device and the node in the MR environment, and the connection between the sensors and the home appliances. On the other hand, it is negatively evaluated for operability.

Original languageEnglish
Title of host publicationICAT-EGVE 2019 - 29th International Conference on Artificial Reality and Telexistence and 24th Eurographics Symposium on Virtual Environments
EditorsYasuaki Kakehi, Atsushi Hiyama, Dieter W. Fellner, Werner Hansmann, Werner Purgathofer, Francois Sillion
PublisherThe Eurographics Association
Pages105-112
Number of pages8
ISBN (Electronic)9783038680833
DOIs
Publication statusPublished - 2019
Event29th International Conference on Artificial Reality and Telexistence and 24th Eurographics Symposium on Virtual Environments, ICAT-EGVE 2019 - Tokyo, Japan
Duration: 2019 Sep 112019 Sep 13

Publication series

NameICAT-EGVE 2019 - 29th International Conference on Artificial Reality and Telexistence and 24th Eurographics Symposium on Virtual Environments

Conference

Conference29th International Conference on Artificial Reality and Telexistence and 24th Eurographics Symposium on Virtual Environments, ICAT-EGVE 2019
Country/TerritoryJapan
CityTokyo
Period19/9/1119/9/13

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'ReallifeEngine: A Mixed Reality-Based Visual Programming System for SmartHomes'. Together they form a unique fingerprint.

Cite this