On-the-fly data compression/decompression mechanism with ExpEther

Hideki Shimura, Takuji Mitsuishi, Hideharu Amano, Masaki Kan, Takashi Yoshikawa

研究成果: Conference contribution

1 引用 (Scopus)

抄録

ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

元の言語English
ホスト出版物のタイトルProceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016
出版者Institute of Electrical and Electronics Engineers Inc.
ページ112-118
ページ数7
ISBN(電子版)9781509026555
DOI
出版物ステータスPublished - 2017 1 13
イベント4th International Symposium on Computing and Networking, CANDAR 2016 - Hiroshima, Japan
継続期間: 2016 11 222016 11 25

Other

Other4th International Symposium on Computing and Networking, CANDAR 2016
Japan
Hiroshima
期間16/11/2216/11/25

Fingerprint

Data compression
Ethernet
Bandwidth
Program processors
Field programmable gate arrays (FPGA)
Hardware
Graphics processing unit

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Signal Processing
  • Computer Networks and Communications

これを引用

Shimura, H., Mitsuishi, T., Amano, H., Kan, M., & Yoshikawa, T. (2017). On-the-fly data compression/decompression mechanism with ExpEther. : Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016 (pp. 112-118). [7818601] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CANDAR.2016.109

On-the-fly data compression/decompression mechanism with ExpEther. / Shimura, Hideki; Mitsuishi, Takuji; Amano, Hideharu; Kan, Masaki; Yoshikawa, Takashi.

Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. p. 112-118 7818601.

研究成果: Conference contribution

Shimura, H, Mitsuishi, T, Amano, H, Kan, M & Yoshikawa, T 2017, On-the-fly data compression/decompression mechanism with ExpEther. : Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016., 7818601, Institute of Electrical and Electronics Engineers Inc., pp. 112-118, 4th International Symposium on Computing and Networking, CANDAR 2016, Hiroshima, Japan, 16/11/22. https://doi.org/10.1109/CANDAR.2016.109
Shimura H, Mitsuishi T, Amano H, Kan M, Yoshikawa T. On-the-fly data compression/decompression mechanism with ExpEther. : Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 112-118. 7818601 https://doi.org/10.1109/CANDAR.2016.109
Shimura, Hideki ; Mitsuishi, Takuji ; Amano, Hideharu ; Kan, Masaki ; Yoshikawa, Takashi. / On-the-fly data compression/decompression mechanism with ExpEther. Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 112-118
@inproceedings{9d100ffdbb784f86b8ddebe911760b15,
title = "On-the-fly data compression/decompression mechanism with ExpEther",
abstract = "ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28{\%} while the latter reduces it to 27{\%} when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.",
author = "Hideki Shimura and Takuji Mitsuishi and Hideharu Amano and Masaki Kan and Takashi Yoshikawa",
year = "2017",
month = "1",
day = "13",
doi = "10.1109/CANDAR.2016.109",
language = "English",
pages = "112--118",
booktitle = "Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - On-the-fly data compression/decompression mechanism with ExpEther

AU - Shimura, Hideki

AU - Mitsuishi, Takuji

AU - Amano, Hideharu

AU - Kan, Masaki

AU - Yoshikawa, Takashi

PY - 2017/1/13

Y1 - 2017/1/13

N2 - ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

AB - ExpEther is a virtualization technique that extends PCIe of a host CPU to Ethernet. Since all devices connected by ExpEther can be treated as if they were directly connected to the host, a multi-GPU system called GBU-BOX that connects a number of GPUs virtually to a host can be easily developed. However, the smaller bandwidth of Ethernet compared to PCIe often bottlenecks the system. An on-the-fly data compression/decompression mechanism is proposed for the ExpEther NIC to compensate for the gap in bandwidth between PCIe and Ethernet. Two algorithms, WAH and SECOMPAX, are implemented on an FPGA for compressing bitmap index data. The former reduces the amount of data on Ethernet to 28% while the latter reduces it to 27% when Graph500 BSF is executed on GPU-BOX. Considering the hardware overhead, WAH is a good solution for applications.

UR - http://www.scopus.com/inward/record.url?scp=85015180155&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015180155&partnerID=8YFLogxK

U2 - 10.1109/CANDAR.2016.109

DO - 10.1109/CANDAR.2016.109

M3 - Conference contribution

AN - SCOPUS:85015180155

SP - 112

EP - 118

BT - Proceedings - 2016 4th International Symposium on Computing and Networking, CANDAR 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -