TY - GEN
T1 - Wire-speed implementation of sliding-window aggregate operator over out-of-order data streams
AU - Oge, Yasin
AU - Yoshimi, Masato
AU - Miyoshi, Takefumi
AU - Kawashima, Hideyuki
AU - Irie, Hidetsugu
AU - Yoshinaga, Tsutomu
PY - 2013/1/1
Y1 - 2013/1/1
N2 - This paper shows the design and evaluation of an FPGA-based accelerator for sliding-window aggregation over data streams with out-of-order data arrival. We propose an order-agnostic hardware implementation technique for windowing operators based on a one-pass query evaluation strategy called Window-ID, which is originally proposed for software implementation. The proposed implementation succeeds to process out-of-order data items, or tuples, at wire speed due to the simultaneous evaluations of overlapping sliding-windows. In order to verify the effectiveness of the proposed approach, we have also implemented an experimental system as a case study. Our experiments demonstrate that the proposed accelerator with a network interface achieves an effective throughput around 760 Mbps or equivalently nearly 6 million tuples per second, by fully utilizing the available bandwidth of the network interface.
AB - This paper shows the design and evaluation of an FPGA-based accelerator for sliding-window aggregation over data streams with out-of-order data arrival. We propose an order-agnostic hardware implementation technique for windowing operators based on a one-pass query evaluation strategy called Window-ID, which is originally proposed for software implementation. The proposed implementation succeeds to process out-of-order data items, or tuples, at wire speed due to the simultaneous evaluations of overlapping sliding-windows. In order to verify the effectiveness of the proposed approach, we have also implemented an experimental system as a case study. Our experiments demonstrate that the proposed accelerator with a network interface achieves an effective throughput around 760 Mbps or equivalently nearly 6 million tuples per second, by fully utilizing the available bandwidth of the network interface.
KW - Data stream processing
KW - Disordered data
KW - FPGA
KW - Sliding-window aggregates
KW - Stream punctuation
UR - http://www.scopus.com/inward/record.url?scp=84892635459&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84892635459&partnerID=8YFLogxK
U2 - 10.1109/MCSoC.2013.23
DO - 10.1109/MCSoC.2013.23
M3 - Conference contribution
AN - SCOPUS:84892635459
SN - 9780768550862
T3 - Proceedings - IEEE 7th International Symposium on Embedded Multicore/Manycore System-on-Chip, MCSoC 2013
SP - 55
EP - 60
BT - Proceedings - IEEE 7th International Symposium on Embedded Multicore/Manycore System-on-Chip, MCSoC 2013
PB - IEEE Computer Society
T2 - 2013 IEEE 7th International Symposium on Embedded Multicore/Manycore System-on-Chip, MCSoC 2013
Y2 - 26 September 2013 through 28 September 2013
ER -