On-the-fly data compression/decompression mechanism with ExpEther

Hideki Shimura, Takuji Mitsuishi, Hideharu Amano, Masaki Kan, Takashi Yoshikawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

Original languageEnglish
Title of host publicationProceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages112-118
Number of pages7
ISBN (Electronic)9781509026555
DOIs
Publication statusPublished - 2017 Jan 13
Event4th International Symposium on Computing and Networking, CANDAR 2016 - Hiroshima, Japan
Duration: 2016 Nov 222016 Nov 25

Other

Other4th International Symposium on Computing and Networking, CANDAR 2016
CountryJapan
CityHiroshima
Period16/11/2216/11/25

Fingerprint

Data compression
Ethernet
Bandwidth
Program processors
Field programmable gate arrays (FPGA)
Hardware
Graphics processing unit

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Signal Processing
  • Computer Networks and Communications

Cite this

Shimura, H., Mitsuishi, T., Amano, H., Kan, M., & Yoshikawa, T. (2017). On-the-fly data compression/decompression mechanism with ExpEther. In Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016 (pp. 112-118). [7818601] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CANDAR.2016.109

On-the-fly data compression/decompression mechanism with ExpEther. / Shimura, Hideki; Mitsuishi, Takuji; Amano, Hideharu; Kan, Masaki; Yoshikawa, Takashi.

Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. p. 112-118 7818601.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Shimura, H, Mitsuishi, T, Amano, H, Kan, M & Yoshikawa, T 2017, On-the-fly data compression/decompression mechanism with ExpEther. in Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016., 7818601, Institute of Electrical and Electronics Engineers Inc., pp. 112-118, 4th International Symposium on Computing and Networking, CANDAR 2016, Hiroshima, Japan, 16/11/22. https://doi.org/10.1109/CANDAR.2016.109
Shimura H, Mitsuishi T, Amano H, Kan M, Yoshikawa T. On-the-fly data compression/decompression mechanism with ExpEther. In Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 112-118. 7818601 https://doi.org/10.1109/CANDAR.2016.109
Shimura, Hideki ; Mitsuishi, Takuji ; Amano, Hideharu ; Kan, Masaki ; Yoshikawa, Takashi. / On-the-fly data compression/decompression mechanism with ExpEther. Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 112-118
@inproceedings{9d100ffdbb784f86b8ddebe911760b15,
title = "On-the-fly data compression/decompression mechanism with ExpEther",
abstract = "ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28{\%} while the latter reduces it to 27{\%} when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.",
author = "Hideki Shimura and Takuji Mitsuishi and Hideharu Amano and Masaki Kan and Takashi Yoshikawa",
year = "2017",
month = "1",
day = "13",
doi = "10.1109/CANDAR.2016.109",
language = "English",
pages = "112--118",
booktitle = "Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - On-the-fly data compression/decompression mechanism with ExpEther

AU - Shimura, Hideki

AU - Mitsuishi, Takuji

AU - Amano, Hideharu

AU - Kan, Masaki

AU - Yoshikawa, Takashi

PY - 2017/1/13

Y1 - 2017/1/13

N2 - ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

AB - ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

UR - http://www.scopus.com/inward/record.url?scp=85015180155&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015180155&partnerID=8YFLogxK

U2 - 10.1109/CANDAR.2016.109

DO - 10.1109/CANDAR.2016.109

M3 - Conference contribution

AN - SCOPUS:85015180155

SP - 112

EP - 118

BT - Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -