TY - JOUR
T1 - Efficient window aggregate method on array database system
AU - Jiang, Li
AU - Kawashima, Hideyuki
AU - Tatebe, Osamu
N1 - Publisher Copyright:
© 2016 Information Processing Society of Japan.
Copyright:
Copyright 2018 Elsevier B.V., All rights reserved.
PY - 2016
Y1 - 2016
N2 - An array database is effective for managing a massive amount of sensor data, and the window aggregate is a popular operator. We propose an efficient window aggregate method over multi-dimensional array data based on incremental computation. We improve five types of aggregates by exploiting different data structures: list for summation and average, heap for maximum and minimum, and balanced binary search tree for percentile. We design and fully implement the proposed method in SciDB using the plugin mechanism. In addition, we evaluate the performance through experiments using the synthetic and JRA-55 meteorological datasets. The results of our experiments on SciDB are consistent with our analytic findings. The proposed method achieves a 17.9x, 12.5x, and 10.2x performance improvement for minimum, summation, and percentile operators, respectively, compared with SciDB built-in operators. These results align with our time-complexity analysis results.
AB - An array database is effective for managing a massive amount of sensor data, and the window aggregate is a popular operator. We propose an efficient window aggregate method over multi-dimensional array data based on incremental computation. We improve five types of aggregates by exploiting different data structures: list for summation and average, heap for maximum and minimum, and balanced binary search tree for percentile. We design and fully implement the proposed method in SciDB using the plugin mechanism. In addition, we evaluate the performance through experiments using the synthetic and JRA-55 meteorological datasets. The results of our experiments on SciDB are consistent with our analytic findings. The proposed method achieves a 17.9x, 12.5x, and 10.2x performance improvement for minimum, summation, and percentile operators, respectively, compared with SciDB built-in operators. These results align with our time-complexity analysis results.
KW - Array database
KW - Incremental computation
KW - Multi-dimensional array
KW - Window aggregate
UR - http://www.scopus.com/inward/record.url?scp=84995617519&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84995617519&partnerID=8YFLogxK
U2 - 10.2197/ipsjjip.24.867
DO - 10.2197/ipsjjip.24.867
M3 - Article
AN - SCOPUS:84995617519
VL - 24
SP - 867
EP - 877
JO - Journal of Information Processing
JF - Journal of Information Processing
SN - 0387-5806
IS - 6
ER -