Performance evaluation of power-aware multi-tree ethernet for HPC interconnects

Michihiro Koibuchi, Takafumi Watanabe, Atsushi Minamihata, Masahiro Nakao, Tomoyuki Hiroyasu, Hiroki Matsutani, Hideharu Amano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Ethernet has been used for interconnection networks of high-performance computing (HPC) systems that include PC clusters. Although a layer-2 Ethernet topology is limited to a tree structure in order to avoid broadcast storms and deadlocks of frames, various topologies with deadlock-free routing, that include loops, suitable for parallel processing can be used by the application of IEEE 802.1Q VLAN technology. However, their performance and power evaluations on real PC clusters with Ethernet have been rarely done. Thus, their evaluation on real PC clusters with Ethernet is important to analyze their impact on the total systems and validate their simulation results. In this paper, firstly we measure tree, and fully connected topologies with link aggregation on a 66-node/528-core PC cluster with a number of Ethernet switches. Secondly, we measure the optimization of the power consumption of Ethernet by a power-aware link regulation in order to reduce the power consumption of Ethernet switches on a real PC cluster. Measurement results show that the fully connected topology achieves 3.21 TFlops in High-Performance Linpack Benchmark (HPL), and its Rmax/Rpeak value is 67%. Up to 23% of the power consumption of networks can be reduced by the power-aware link regulation, while the performance is degraded by less than 1%.

Original languageEnglish
Title of host publicationProceedings - 2011 2nd International Conference on Networking and Computing, ICNC 2011
Pages50-57
Number of pages8
DOIs
Publication statusPublished - 2011 Dec 1
Event2nd International Conference on Networking and Computing, ICNC 2011 - Osaka, Japan
Duration: 2011 Nov 302011 Dec 2

Publication series

NameProceedings - 2011 2nd International Conference on Networking and Computing, ICNC 2011

Other

Other2nd International Conference on Networking and Computing, ICNC 2011
CountryJapan
CityOsaka
Period11/11/3011/12/2

Keywords

  • Ethernet
  • cluster interconnects
  • interconnection networks
  • performance measurement
  • topology

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Performance evaluation of power-aware multi-tree ethernet for HPC interconnects'. Together they form a unique fingerprint.

  • Cite this

    Koibuchi, M., Watanabe, T., Minamihata, A., Nakao, M., Hiroyasu, T., Matsutani, H., & Amano, H. (2011). Performance evaluation of power-aware multi-tree ethernet for HPC interconnects. In Proceedings - 2011 2nd International Conference on Networking and Computing, ICNC 2011 (pp. 50-57). [6131793] (Proceedings - 2011 2nd International Conference on Networking and Computing, ICNC 2011). https://doi.org/10.1109/ICNC.2011.17