On-the-fly data compression/decompression mechanism with ExpEther

Hideki Shimura; Takuji Mitsuishi; Hideharu Amano; Masaki Kan; Takashi Yoshikawa

doi:10.1109/CANDAR.2016.109

On-the-fly data compression/decompression mechanism with ExpEther

Hideki Shimura, Takuji Mitsuishi, Hideharu Amano, Masaki Kan, Takashi Yoshikawa

Department of Information and Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

Original language	English
Title of host publication	Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	112-118
Number of pages	7
ISBN (Electronic)	9781509026555
DOIs	https://doi.org/10.1109/CANDAR.2016.109
Publication status	Published - 2017 Jan 13
Event	4th International Symposium on Computing and Networking, CANDAR 2016 - Hiroshima, Japan Duration: 2016 Nov 22 → 2016 Nov 25

Other

Other	4th International Symposium on Computing and Networking, CANDAR 2016
Country	Japan
City	Hiroshima
Period	16/11/22 → 16/11/25

ASJC Scopus subject areas

Computer Science Applications
Hardware and Architecture
Signal Processing
Computer Networks and Communications

Access to Document

10.1109/CANDAR.2016.109

Fingerprint Dive into the research topics of 'On-the-fly data compression/decompression mechanism with ExpEther'. Together they form a unique fingerprint.

Cite this

Shimura, H., Mitsuishi, T., Amano, H., Kan, M., & Yoshikawa, T. (2017). On-the-fly data compression/decompression mechanism with ExpEther. In Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016 (pp. 112-118). [7818601] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CANDAR.2016.109

On-the-fly data compression/decompression mechanism with ExpEther. / Shimura, Hideki; Mitsuishi, Takuji; Amano, Hideharu; Kan, Masaki; Yoshikawa, Takashi.

Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. p. 112-118 7818601.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Shimura, H, Mitsuishi, T, Amano, H, Kan, M & Yoshikawa, T 2017, On-the-fly data compression/decompression mechanism with ExpEther. in Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016., 7818601, Institute of Electrical and Electronics Engineers Inc., pp. 112-118, 4th International Symposium on Computing and Networking, CANDAR 2016, Hiroshima, Japan, 16/11/22. https://doi.org/10.1109/CANDAR.2016.109

@inproceedings{9d100ffdbb784f86b8ddebe911760b15,

title = "On-the-fly data compression/decompression mechanism with ExpEther",

abstract = "ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.",

author = "Hideki Shimura and Takuji Mitsuishi and Hideharu Amano and Masaki Kan and Takashi Yoshikawa",

year = "2017",

month = jan,

day = "13",

doi = "10.1109/CANDAR.2016.109",

language = "English",

pages = "112--118",

booktitle = "Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "4th International Symposium on Computing and Networking, CANDAR 2016 ; Conference date: 22-11-2016 Through 25-11-2016",

}

TY - GEN

T1 - On-the-fly data compression/decompression mechanism with ExpEther

AU - Shimura, Hideki

AU - Mitsuishi, Takuji

AU - Amano, Hideharu

AU - Kan, Masaki

AU - Yoshikawa, Takashi

PY - 2017/1/13

Y1 - 2017/1/13

N2 - ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

AB - ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

UR - http://www.scopus.com/inward/record.url?scp=85015180155&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015180155&partnerID=8YFLogxK

U2 - 10.1109/CANDAR.2016.109

DO - 10.1109/CANDAR.2016.109

M3 - Conference contribution

AN - SCOPUS:85015180155

SP - 112

EP - 118

BT - Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 4th International Symposium on Computing and Networking, CANDAR 2016

Y2 - 22 November 2016 through 25 November 2016

ER -