Three-dimensional spatial join count exploiting CPU optimized STR R-tree

Ryuya Mitsuhashi, Hideyuki Kawashima, Takahiro Nishimichi, Osamu Tatebe

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

In this study, we attempt to address the issue regarding the spatial join count, where in the number of particles around a halo is counted only once for a given simulation result. An efficient spatial index is necessary for accelerated counting; therefore, we propose a CPU optimized sort-tile-recursive R-tree that employs a parallel radix sort and node packing with thread pool and single instruction multiple data instructions. In an experiment conducted with astronomical data, the proposed method demonstrates an improvement in performance by 26.8 times compared with that using a conventional CPU optimized R-tree. We also propose a partial materialization approach to handle large amount of data that exceeds the capacity of main memory. To accelerate the approach, we propose a construct-search-destruct pipeline that exploits a thread pool to conceal the latency of the construction and destruction of the index. The pipelining method achieves an improvement in performance by 27.5 times compared with that of a conventional CPU optimized R-tree. All our codes are available on GitHub.

本文言語English
ホスト出版物のタイトルProceedings - 2016 IEEE International Conference on Big Data, Big Data 2016
編集者Ronay Ak, George Karypis, Yinglong Xia, Xiaohua Tony Hu, Philip S. Yu, James Joshi, Lyle Ungar, Ling Liu, Aki-Hiro Sato, Toyotaro Suzumura, Sudarsan Rachuri, Rama Govindaraju, Weijia Xu
出版社Institute of Electrical and Electronics Engineers Inc.
ページ2938-2947
ページ数10
ISBN(電子版)9781467390040
DOI
出版ステータスPublished - 2016
外部発表はい
イベント4th IEEE International Conference on Big Data, Big Data 2016 - Washington, United States
継続期間: 2016 12 52016 12 8

出版物シリーズ

名前Proceedings - 2016 IEEE International Conference on Big Data, Big Data 2016

Other

Other4th IEEE International Conference on Big Data, Big Data 2016
国/地域United States
CityWashington
Period16/12/516/12/8

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • 情報システム
  • ハードウェアとアーキテクチャ

フィンガープリント

「Three-dimensional spatial join count exploiting CPU optimized STR R-tree」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル