An Edge Attribute-Wise Partitioning and Distributed Processing of R-GCN Using GPUs

Tokio Kibata, Mineto Tsukada, Hiroki Matsutani

研究成果: Conference contribution

抄録

R-GCN (Relational Graph Convolutional Network) is one of GNNs (Graph Neural Networks). The model tries predicting latent information by considering directions and types of edges in graph-structured data, such as knowledge bases. The model builds weight matrices to each edge attribute. Thus, the size of the neural network increases linearly with the number of edge types. Although GPUs can be used for accelerating the R-GCN processing, there is a possibility that the size of weight matrices exceeds GPU device memory. To address this issue, in this paper, an edge attribute-wise partitioning is proposed for R-GCN. The proposed partitioning divides the model and graph data so that R-GCN can be accelerated by using multiple GPUs. Also, the proposed approach can be applied to sequential execution on a single GPU. Both the cases can accelerate the R-GCN processing with large graph data, where the original model cannot be fit into a device memory of a single GPU without partitioning. Experimental results demonstrate that our partitioning method accelerates R-GCN by up to 3.28 times using four GPUs compared to CPU execution for a dataset with more than 1.6 million nodes and 5 million edges. Also, the proposed approach can accelerate the execution even with a single GPU by 1.55 times compared to the CPU execution for a dataset with 0.8 million nodes and 2 million edges.

本文言語English
ホスト出版物のタイトルEuro-Par 2020
ホスト出版物のサブタイトルParallel Processing Workshops - Euro-Par 2020 International Workshops, 2020, Revised Selected Papers
編集者Bartosz Balis, Dora B. Heras, Laura Antonelli, Andrea Bracciali, Thomas Gruber, Jin Hyun-Wook, Michael Kuhn, Stephen L. Scott, Didem Unat, Roman Wyrzykowski
出版社Springer Science and Business Media Deutschland GmbH
ページ122-134
ページ数13
ISBN(印刷版)9783030715922
DOI
出版ステータスPublished - 2021
イベントWorkshops held at the 26th International Conference on Parallel and Distributed Computing, Euro-Par 2020 - Virtual, Online
継続期間: 2020 8 242020 8 25

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
12480 LNCS
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

Conference

ConferenceWorkshops held at the 26th International Conference on Parallel and Distributed Computing, Euro-Par 2020
CityVirtual, Online
Period20/8/2420/8/25

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)

フィンガープリント

「An Edge Attribute-Wise Partitioning and Distributed Processing of R-GCN Using GPUs」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル