Trax solver on Zynq with Deep Q-Network

Naru Sugimoto, Takuji Mitsuishi, Takahiro Kaneda, Chiharu Tsuruta, Ryotaro Sakai, Hideki Shimura, Hideharu Amano

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

A software/hardware co-design system for a Trax solver is proposed. Implementation of Trax AI is challenging due to its complicated rules, so we adopted an embedded system called Zynq (Zynq-7000 AP SoC) and introduced a High Level Synthesis (HLS) design. We also added Deep Q-Network, a machine learning algorithm, to the system for use as an evaluation function. Our solver automatically optimizes its own evaluation function through games with humans or other AIs. The implemented solver works with a 150-MHz clock on the Xilinx XC7Z020-CLG484 of a Digilent ZedBoard. A part of the Deep Q-Network job can be executed on the FPGA of the Zynq board more than 26 times faster than with ARM Coretex-A9 650-MHz software.

Original languageEnglish
Title of host publication2015 International Conference on Field Programmable Technology, FPT 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages272-275
Number of pages4
ISBN (Print)9781467390910
DOIs
Publication statusPublished - 2016 Jan 25
EventInternational Conference on Field Programmable Technology, FPT 2015 - Queenstown, New Zealand
Duration: 2015 Dec 72015 Dec 9

Other

OtherInternational Conference on Field Programmable Technology, FPT 2015
CountryNew Zealand
CityQueenstown
Period15/12/715/12/9

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Software

Fingerprint Dive into the research topics of 'Trax solver on Zynq with Deep Q-Network'. Together they form a unique fingerprint.

  • Cite this

    Sugimoto, N., Mitsuishi, T., Kaneda, T., Tsuruta, C., Sakai, R., Shimura, H., & Amano, H. (2016). Trax solver on Zynq with Deep Q-Network. In 2015 International Conference on Field Programmable Technology, FPT 2015 (pp. 272-275). [7393122] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FPT.2015.7393122