Survey of real-time processing technologies of IoT data streams

Keiichi Yasumoto, Hirozumi Yamaguchi, Hiroshi Shigeno

Research output: Contribution to journalArticle

43 Citations (Scopus)

Abstract

Recently, Internet of Things (IoT) has been attracting attention due to its economical impact and high expectations for drastically changing our modern societies. Worldwide by 2022, over 50 billion IoT devices including sensors and actuators are predicted to be installed in machines, humans, vehicles, buildings, and environments. Demand is also huge for the real-time utilization of IoT data streams instead of the current off-line analysis/utilization of stored big data. The real-time utilization of massive IoT data streams suggests a paradigm shift to new horizontal and distributed architecture because existing cloud-based centralized architecture will cause large delays for providing service and waste many resources on the cloud and on networks. Content curation, which is the intelligent compilation of valuable content from IoT data streams, is another key to fully utilize and penetrate IoT technologies. In this pa- per, we survey the emerging technologies toward the real-time utilization of IoT data streams in terms of networking, processing, and content curation and clarify the open issues. Then we propose a new framework for IoT data streams called the Information Flow of Things (IFoT) that processes, analyzes, and curates massive IoT streams in real-time based on distributed processing among IoT devices.

Original languageEnglish
Pages (from-to)195-202
Number of pages8
JournalJournal of Information Processing
Volume24
Issue number2
DOIs
Publication statusPublished - 2016 Mar 15

Fingerprint

Processing
Internet of things
Actuators
Sensors

Keywords

  • Content curation
  • Data stream
  • Distributed processing
  • IoT
  • On-line learning
  • Real-time processing

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Survey of real-time processing technologies of IoT data streams. / Yasumoto, Keiichi; Yamaguchi, Hirozumi; Shigeno, Hiroshi.

In: Journal of Information Processing, Vol. 24, No. 2, 15.03.2016, p. 195-202.

Research output: Contribution to journalArticle

Yasumoto, Keiichi ; Yamaguchi, Hirozumi ; Shigeno, Hiroshi. / Survey of real-time processing technologies of IoT data streams. In: Journal of Information Processing. 2016 ; Vol. 24, No. 2. pp. 195-202.
@article{3a3a016dcaba40c3805d71fc93148a72,
title = "Survey of real-time processing technologies of IoT data streams",
abstract = "Recently, Internet of Things (IoT) has been attracting attention due to its economical impact and high expectations for drastically changing our modern societies. Worldwide by 2022, over 50 billion IoT devices including sensors and actuators are predicted to be installed in machines, humans, vehicles, buildings, and environments. Demand is also huge for the real-time utilization of IoT data streams instead of the current off-line analysis/utilization of stored big data. The real-time utilization of massive IoT data streams suggests a paradigm shift to new horizontal and distributed architecture because existing cloud-based centralized architecture will cause large delays for providing service and waste many resources on the cloud and on networks. Content curation, which is the intelligent compilation of valuable content from IoT data streams, is another key to fully utilize and penetrate IoT technologies. In this pa- per, we survey the emerging technologies toward the real-time utilization of IoT data streams in terms of networking, processing, and content curation and clarify the open issues. Then we propose a new framework for IoT data streams called the Information Flow of Things (IFoT) that processes, analyzes, and curates massive IoT streams in real-time based on distributed processing among IoT devices.",
keywords = "Content curation, Data stream, Distributed processing, IoT, On-line learning, Real-time processing",
author = "Keiichi Yasumoto and Hirozumi Yamaguchi and Hiroshi Shigeno",
year = "2016",
month = "3",
day = "15",
doi = "10.2197/ipsjjip.24.195]",
language = "English",
volume = "24",
pages = "195--202",
journal = "Journal of Information Processing",
issn = "0387-5806",
publisher = "Information Processing Society of Japan",
number = "2",

}

TY - JOUR

T1 - Survey of real-time processing technologies of IoT data streams

AU - Yasumoto, Keiichi

AU - Yamaguchi, Hirozumi

AU - Shigeno, Hiroshi

PY - 2016/3/15

Y1 - 2016/3/15

N2 - Recently, Internet of Things (IoT) has been attracting attention due to its economical impact and high expectations for drastically changing our modern societies. Worldwide by 2022, over 50 billion IoT devices including sensors and actuators are predicted to be installed in machines, humans, vehicles, buildings, and environments. Demand is also huge for the real-time utilization of IoT data streams instead of the current off-line analysis/utilization of stored big data. The real-time utilization of massive IoT data streams suggests a paradigm shift to new horizontal and distributed architecture because existing cloud-based centralized architecture will cause large delays for providing service and waste many resources on the cloud and on networks. Content curation, which is the intelligent compilation of valuable content from IoT data streams, is another key to fully utilize and penetrate IoT technologies. In this pa- per, we survey the emerging technologies toward the real-time utilization of IoT data streams in terms of networking, processing, and content curation and clarify the open issues. Then we propose a new framework for IoT data streams called the Information Flow of Things (IFoT) that processes, analyzes, and curates massive IoT streams in real-time based on distributed processing among IoT devices.

AB - Recently, Internet of Things (IoT) has been attracting attention due to its economical impact and high expectations for drastically changing our modern societies. Worldwide by 2022, over 50 billion IoT devices including sensors and actuators are predicted to be installed in machines, humans, vehicles, buildings, and environments. Demand is also huge for the real-time utilization of IoT data streams instead of the current off-line analysis/utilization of stored big data. The real-time utilization of massive IoT data streams suggests a paradigm shift to new horizontal and distributed architecture because existing cloud-based centralized architecture will cause large delays for providing service and waste many resources on the cloud and on networks. Content curation, which is the intelligent compilation of valuable content from IoT data streams, is another key to fully utilize and penetrate IoT technologies. In this pa- per, we survey the emerging technologies toward the real-time utilization of IoT data streams in terms of networking, processing, and content curation and clarify the open issues. Then we propose a new framework for IoT data streams called the Information Flow of Things (IFoT) that processes, analyzes, and curates massive IoT streams in real-time based on distributed processing among IoT devices.

KW - Content curation

KW - Data stream

KW - Distributed processing

KW - IoT

KW - On-line learning

KW - Real-time processing

UR - http://www.scopus.com/inward/record.url?scp=84961193629&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84961193629&partnerID=8YFLogxK

U2 - 10.2197/ipsjjip.24.195]

DO - 10.2197/ipsjjip.24.195]

M3 - Article

AN - SCOPUS:84961193629

VL - 24

SP - 195

EP - 202

JO - Journal of Information Processing

JF - Journal of Information Processing

SN - 0387-5806

IS - 2

ER -