Design and evaluation of a configurable query processing hardware for data streams

Yasin Oge, Masato Yoshimi, Takefumi Miyoshi, Hideyuki Kawashima, Hidetsugu Irie, Tsutomu Yoshinaga

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimaloverhead execution engine designed to deliver real-time response for highvolume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQLlike queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).

Original languageEnglish
Pages (from-to)2207-2217
Number of pages11
JournalIEICE Transactions on Information and Systems
VolumeE98D
Issue number12
DOIs
Publication statusPublished - 2015 Dec 1
Externally publishedYes

Fingerprint

Query processing
Hardware
Field programmable gate arrays (FPGA)
Particle accelerators
Scalability
Clocks
Agglomeration
Engines

Keywords

  • Configurable hardware architecture
  • Data stream
  • FPGA
  • Query processing
  • Sliding-window aggregation

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Cite this

Design and evaluation of a configurable query processing hardware for data streams. / Oge, Yasin; Yoshimi, Masato; Miyoshi, Takefumi; Kawashima, Hideyuki; Irie, Hidetsugu; Yoshinaga, Tsutomu.

In: IEICE Transactions on Information and Systems, Vol. E98D, No. 12, 01.12.2015, p. 2207-2217.

Research output: Contribution to journalArticle

Oge, Yasin ; Yoshimi, Masato ; Miyoshi, Takefumi ; Kawashima, Hideyuki ; Irie, Hidetsugu ; Yoshinaga, Tsutomu. / Design and evaluation of a configurable query processing hardware for data streams. In: IEICE Transactions on Information and Systems. 2015 ; Vol. E98D, No. 12. pp. 2207-2217.
@article{d62dc0a7544643419bead7a03e55c8ed,
title = "Design and evaluation of a configurable query processing hardware for data streams",
abstract = "In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimaloverhead execution engine designed to deliver real-time response for highvolume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQLlike queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).",
keywords = "Configurable hardware architecture, Data stream, FPGA, Query processing, Sliding-window aggregation",
author = "Yasin Oge and Masato Yoshimi and Takefumi Miyoshi and Hideyuki Kawashima and Hidetsugu Irie and Tsutomu Yoshinaga",
year = "2015",
month = "12",
day = "1",
doi = "10.1587/transinf.2015EDP7203",
language = "English",
volume = "E98D",
pages = "2207--2217",
journal = "IEICE Transactions on Information and Systems",
issn = "0916-8532",
publisher = "Maruzen Co., Ltd/Maruzen Kabushikikaisha",
number = "12",

}

TY - JOUR

T1 - Design and evaluation of a configurable query processing hardware for data streams

AU - Oge, Yasin

AU - Yoshimi, Masato

AU - Miyoshi, Takefumi

AU - Kawashima, Hideyuki

AU - Irie, Hidetsugu

AU - Yoshinaga, Tsutomu

PY - 2015/12/1

Y1 - 2015/12/1

N2 - In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimaloverhead execution engine designed to deliver real-time response for highvolume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQLlike queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).

AB - In this paper, we propose Configurable Query Processing Hardware (CQPH), an FPGA-based accelerator for continuous query processing over data streams. CQPH is a highly optimized and minimaloverhead execution engine designed to deliver real-time response for highvolume data streams. Unlike most of the other FPGA-based approaches, CQPH provides on-the-fly configurability for multiple queries with its own dynamic configuration mechanism. With a dedicated query compiler, SQLlike queries can be easily configured into CQPH at run time. CQPH supports continuous queries including selection, group-by operation and sliding-window aggregation with a large number of overlapping sliding windows. As a proof of concept, a prototype of CQPH is implemented on an FPGA platform for a case study. Evaluation results indicate that a given query can be configured within just a few microseconds, and the prototype implementation of CQPH can process over 150 million tuples per second with a latency of less than a microsecond. Results also indicate that CQPH provides linear scalability to increase its flexibility (i.e., on-the-fly configurability) without sacrificing performance (i.e., maximum allowable clock speed).

KW - Configurable hardware architecture

KW - Data stream

KW - FPGA

KW - Query processing

KW - Sliding-window aggregation

UR - http://www.scopus.com/inward/record.url?scp=84948780541&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84948780541&partnerID=8YFLogxK

U2 - 10.1587/transinf.2015EDP7203

DO - 10.1587/transinf.2015EDP7203

M3 - Article

AN - SCOPUS:84948780541

VL - E98D

SP - 2207

EP - 2217

JO - IEICE Transactions on Information and Systems

JF - IEICE Transactions on Information and Systems

SN - 0916-8532

IS - 12

ER -