Scalable Online Index Construction with Multi-core cpus

Hiroyuki Yamada, Motomichi Toyama

研究成果: Conference article査読

2 被引用数 (Scopus)

抄録

Inverted index is a core element of current text retrieval systems. They can be dynamically constructed using online indexing approaches in the environment which even a small delay in timeliness cannot be tolerated, and the index must always be queryable and up to date. Recently, efficient online index construction schemes have been proposed, however, previous works have not focused on scalability with the modern commodity hardware resources such as multi-core CPUs. In this paper, we propose a scalable online index construction method that better utilizes multicore CPUs. Using experiments on 30 GB of web data, we demonstrate the efficiency of our method in practice, showing that it dramatically reduces online index construction time without sacrificing query performance.

本文言語English
ページ(範囲)29-36
ページ数8
ジャーナルConferences in Research and Practice in Information Technology Series
104
出版ステータスPublished - 2010 12月 1
イベント21st Australasian Database Conference, ADC 2010 - Brisbane, QLD, Australia
継続期間: 2010 1月 182010 1月 21

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • コンピュータ サイエンスの応用
  • ハードウェアとアーキテクチャ
  • 情報システム
  • ソフトウェア

フィンガープリント

「Scalable Online Index Construction with Multi-core cpus」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル