Prediction router: Yet another low latency on-chip router architecture

Hiroki Matsutani, Michihiro Koibuchi, Hideharu Amano, Tsutomu Yoshinaga

研究成果: Conference contribution

66 被引用数 (Scopus)


Network-on-Chips (NoCs) are quite latency sensitive, since their communication latency strongly affects the application performance on recent many-core architectures. To reduce the communication latency, we propose a lowlatency router architecture that predicts an output channel being used by the next packet transfer and speculatively completes the switch arbitration. In the prediction routers, incoming packets are transferred without waiting the routing computation and switch arbitration if the prediction hits. Thus, the primary concern for reducing the communication latency is the hit rates of prediction algorithms, which vary from the network environments, such asthe network topology, routing algorithm, and traffic pattern. Although typical low-latency routers that speculatively skip one or more pipeline stages use a bypass datapath for specific packet transfers (e.g., packets moving on the same dimension), our prediction router predictively forwards packets based on a prediction algorithm selected from several candidates in response to the network environments. In this paper, we analyze the prediction hit rates of six prediction algorithms on meshes, tori, and fat trees. Then we provide three case studies, each of which assumes different many-core architecture. We have implemented a prediction router for each case study by using a 65nm CMOS process, and evaluated them in terms of the prediction hit rate, zero load latency, hardware amount, and energy consumption. The results show that although the area and energy are increased by 6.4-15.9% and 8.0-9.5% respectively, up to 89.8% of the prediction hit rate is achieved in real applications, which provide favorable trade-offs between the modest hardware/energy overheads and the latency saving.

ホスト出版物のタイトルProceedings - 15th International Symposium on High-Performance Computer Architecture, HPCA - 15 2009
出版社IEEE Computer Society
出版ステータスPublished - 2009
イベントIEEE 15th International Symposium on High Performance Computer Architecture, HPCA 2009 - Raleigh, United States
継続期間: 2009 2月 142009 2月 18


名前Proceedings - International Symposium on High-Performance Computer Architecture


ConferenceIEEE 15th International Symposium on High Performance Computer Architecture, HPCA 2009
国/地域United States

ASJC Scopus subject areas

  • ハードウェアとアーキテクチャ


「Prediction router: Yet another low latency on-chip router architecture」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。