Low-Latency High-Bandwidth Interconnection Networks by Selective Packet Compression

Naoya Niwa, Hideharu Amano, Michihiro Koibuchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Interconnection network ideally transfers the maximum amount of communication dataset within the least amount of time to fully exploit the parallelism of target applications on parallel computer systems. To this goal, we propose a selective data-compression interconnection network. Data compression virtually increases the effective network bandwidth, while each compute node introduces additional latency overhead to perform (de-)compression operation to end-To-end communication latency. To minimize the effect of the compression latency overhead on the end-To-end communication latency, we selectively apply a compression technique to a packet. The compression operation is taken for long packets and is also taken when network congestion is detected at a network interface. Evaluation results show that simple lossless and lossy compression algorithms have up to 3.0 and 1.8 compression ratios for integer and floating-point communication data in some parallel applications, respectively, while the lossy compression algorithm successfully satisfies the required quality of results. Through a cycle-network simulation, the selective compression method using the above compression algorithms improves by up to 46% the network throughput with the moderate increase of the communication latency of short packets.

Original languageEnglish
Title of host publicationProceedings - 2021 9th International Symposium on Computing and Networking, CANDAR 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages56-64
Number of pages9
ISBN (Electronic)9781665442466
DOIs
Publication statusPublished - 2021
Event9th International Symposium on Computing and Networking, CANDAR 2021 - Virtual, Online, Japan
Duration: 2021 Nov 232021 Nov 26

Publication series

NameProceedings - 2021 9th International Symposium on Computing and Networking, CANDAR 2021

Conference

Conference9th International Symposium on Computing and Networking, CANDAR 2021
Country/TerritoryJapan
CityVirtual, Online
Period21/11/2321/11/26

Keywords

  • Congestion control
  • Interconnection network
  • Lossy data compression

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Low-Latency High-Bandwidth Interconnection Networks by Selective Packet Compression'. Together they form a unique fingerprint.

Cite this