DsODENet: Neural ODE and Depthwise Separable Convolution for Domain Adaptation on FPGAs

Hiroki Kawakami, Hirohisa Watanabe, Keisuke Sugiura, Hiroki Matsutani

研究成果: Conference contribution

抄録

High-performance deep neural network (DNN)-based systems are in high demand in edge environments. Due to its high computational complexity, it is challenging to deploy DNNs on edge devices with strict limitations on computational resources. In this paper, we derive a compact while highly-Accurate DNN model, termed dsODENet, by combining recently-proposed parameter reduction techniques: Neural ODE (Ordinary Differential Equation) and DSC (Depthwise Separable Convolution). Neural ODE exploits a similarity between ResNet and ODE, and shares most of weight parameters among multiple layers, which greatly reduces the memory consumption. We apply dsODENet to a domain adaptation as a practical use case with image classification datasets. We also propose a resource-efficient FPGA-based design for dsODENet, where all the parameters and feature maps except for pre-and post-processing layers can be mapped onto onchip memories. It is implemented on Xilinx ZCU104 board and evaluated in terms of domain adaptation accuracy, training speed, FPGA resource utilization, and speedup rate compared to a software counterpart. The results demonstrate that dsODENet achieves comparable or slightly better domain adaptation accuracy compared to our baseline Neural ODE implementation, while the total parameter size without pre-and post-processing layers is reduced by 54.2% to 79.8%. Our FPGA implementation accelerates the inference speed by 27.9 times.

本文言語English
ホスト出版物のタイトルProceedings - 30th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2022
編集者Arturo Gonzalez-Escribano, Jose Daniel Garcia, Massimo Torquati, Amund Skavhaug
出版社Institute of Electrical and Electronics Engineers Inc.
ページ152-156
ページ数5
ISBN(電子版)9781665469586
DOI
出版ステータスPublished - 2022
イベント30th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2022 - Valladolid, Spain
継続期間: 2022 3月 92022 3月 11

出版物シリーズ

名前Proceedings - 30th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2022

Conference

Conference30th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2022
国/地域Spain
CityValladolid
Period22/3/922/3/11

ASJC Scopus subject areas

  • コンピュータ ネットワークおよび通信
  • ハードウェアとアーキテクチャ
  • 情報システムおよび情報管理

フィンガープリント

「DsODENet: Neural ODE and Depthwise Separable Convolution for Domain Adaptation on FPGAs」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル