IP-NUMA for low-latency communication

Takeshi Matsuya, Yohei Kuga, Hideaki Yoshifuji, Rodney D Van Meter, Jun Murai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

With cloud service becoming more popular, low-latency communication is required between servers in a data center. Low-latency node-to-node or application-to-application notification can be achieved in a NUMA [1] (Non-Uniform Memory Access) system, but requires dedicated, special-purpose network infrastructure. However, IP networks are commonly used in data centers. Using a custom FPGA-based NIC, we create NUMA-like behavior using hardware-generated IP packets which can be transmitted over commodity Ethernet switches and IP routers. We demonstrate ping-pong acknowledgments between two PCs equipped with our IP-NUMA boards. Our IP-NUMA implementation exhibits latency as much as ten times lower than software using Berkeley sockets over a consumer-grade Ethernet switch. iSCSI initiator-target communications and transaction-based distributed software systems will benefit from the reduced latency.

Original languageEnglish
Title of host publicationACM International Conference Proceeding Series
PublisherAssociation for Computing Machinery
Volume2014-May
EditionMay
DOIs
Publication statusPublished - 2014 Jun 18
Event9th International Conference on Future Internet Technologies, CFI 2014 - Tokyo, Japan
Duration: 2014 Jun 182014 Jun 20

Other

Other9th International Conference on Future Internet Technologies, CFI 2014
CountryJapan
CityTokyo
Period14/6/1814/6/20

Fingerprint

Ethernet
Switches
Communication
Routers
Field programmable gate arrays (FPGA)
Servers
Hardware
Data storage equipment

Keywords

  • FPGA
  • IPC
  • Low-latency communication
  • NIC
  • NUMA

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Matsuya, T., Kuga, Y., Yoshifuji, H., Van Meter, R. D., & Murai, J. (2014). IP-NUMA for low-latency communication. In ACM International Conference Proceeding Series (May ed., Vol. 2014-May). Association for Computing Machinery. https://doi.org/10.1145/2619287.2619294

IP-NUMA for low-latency communication. / Matsuya, Takeshi; Kuga, Yohei; Yoshifuji, Hideaki; Van Meter, Rodney D; Murai, Jun.

ACM International Conference Proceeding Series. Vol. 2014-May May. ed. Association for Computing Machinery, 2014.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Matsuya, T, Kuga, Y, Yoshifuji, H, Van Meter, RD & Murai, J 2014, IP-NUMA for low-latency communication. in ACM International Conference Proceeding Series. May edn, vol. 2014-May, Association for Computing Machinery, 9th International Conference on Future Internet Technologies, CFI 2014, Tokyo, Japan, 14/6/18. https://doi.org/10.1145/2619287.2619294
Matsuya T, Kuga Y, Yoshifuji H, Van Meter RD, Murai J. IP-NUMA for low-latency communication. In ACM International Conference Proceeding Series. May ed. Vol. 2014-May. Association for Computing Machinery. 2014 https://doi.org/10.1145/2619287.2619294
Matsuya, Takeshi ; Kuga, Yohei ; Yoshifuji, Hideaki ; Van Meter, Rodney D ; Murai, Jun. / IP-NUMA for low-latency communication. ACM International Conference Proceeding Series. Vol. 2014-May May. ed. Association for Computing Machinery, 2014.
@inproceedings{d8befc966edd460eb6f0efcea31fb770,
title = "IP-NUMA for low-latency communication",
abstract = "With cloud service becoming more popular, low-latency communication is required between servers in a data center. Low-latency node-to-node or application-to-application notification can be achieved in a NUMA [1] (Non-Uniform Memory Access) system, but requires dedicated, special-purpose network infrastructure. However, IP networks are commonly used in data centers. Using a custom FPGA-based NIC, we create NUMA-like behavior using hardware-generated IP packets which can be transmitted over commodity Ethernet switches and IP routers. We demonstrate ping-pong acknowledgments between two PCs equipped with our IP-NUMA boards. Our IP-NUMA implementation exhibits latency as much as ten times lower than software using Berkeley sockets over a consumer-grade Ethernet switch. iSCSI initiator-target communications and transaction-based distributed software systems will benefit from the reduced latency.",
keywords = "FPGA, IPC, Low-latency communication, NIC, NUMA",
author = "Takeshi Matsuya and Yohei Kuga and Hideaki Yoshifuji and {Van Meter}, {Rodney D} and Jun Murai",
year = "2014",
month = "6",
day = "18",
doi = "10.1145/2619287.2619294",
language = "English",
volume = "2014-May",
booktitle = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",
edition = "May",

}

TY - GEN

T1 - IP-NUMA for low-latency communication

AU - Matsuya, Takeshi

AU - Kuga, Yohei

AU - Yoshifuji, Hideaki

AU - Van Meter, Rodney D

AU - Murai, Jun

PY - 2014/6/18

Y1 - 2014/6/18

N2 - With cloud service becoming more popular, low-latency communication is required between servers in a data center. Low-latency node-to-node or application-to-application notification can be achieved in a NUMA [1] (Non-Uniform Memory Access) system, but requires dedicated, special-purpose network infrastructure. However, IP networks are commonly used in data centers. Using a custom FPGA-based NIC, we create NUMA-like behavior using hardware-generated IP packets which can be transmitted over commodity Ethernet switches and IP routers. We demonstrate ping-pong acknowledgments between two PCs equipped with our IP-NUMA boards. Our IP-NUMA implementation exhibits latency as much as ten times lower than software using Berkeley sockets over a consumer-grade Ethernet switch. iSCSI initiator-target communications and transaction-based distributed software systems will benefit from the reduced latency.

AB - With cloud service becoming more popular, low-latency communication is required between servers in a data center. Low-latency node-to-node or application-to-application notification can be achieved in a NUMA [1] (Non-Uniform Memory Access) system, but requires dedicated, special-purpose network infrastructure. However, IP networks are commonly used in data centers. Using a custom FPGA-based NIC, we create NUMA-like behavior using hardware-generated IP packets which can be transmitted over commodity Ethernet switches and IP routers. We demonstrate ping-pong acknowledgments between two PCs equipped with our IP-NUMA boards. Our IP-NUMA implementation exhibits latency as much as ten times lower than software using Berkeley sockets over a consumer-grade Ethernet switch. iSCSI initiator-target communications and transaction-based distributed software systems will benefit from the reduced latency.

KW - FPGA

KW - IPC

KW - Low-latency communication

KW - NIC

KW - NUMA

UR - http://www.scopus.com/inward/record.url?scp=84954479229&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954479229&partnerID=8YFLogxK

U2 - 10.1145/2619287.2619294

DO - 10.1145/2619287.2619294

M3 - Conference contribution

VL - 2014-May

BT - ACM International Conference Proceeding Series

PB - Association for Computing Machinery

ER -