Deep Reinforcement Learning for Economic Dispatch of Virtual Power Plant in Internet of Energy

Lin Lin, Xin Guan, Yu Peng, Ning Wang, Sabita Maharjan, Tomoaki Ohtsuki

Research output: Contribution to journalArticle

Abstract

With the high penetration of large-scale distributed renewable energy generation, the power system is facing enormous challenges in terms of the inherent uncertainty of power generation of renewable energy resources. In this regard, virtual power plants (VPPs) can play a crucial role in integrating a large number of distributed generation units (DGs) more effectively to improve the stability of the power systems. Due to the uncertainty and nonlinear characteristics of DGs, reliable economic dispatch in VPPs requires timely and reliable communication between DGs, and between the generation side and the load side. The online economic dispatch optimizes the cost of VPPs. In this article, we propose a deep reinforcement learning (DRL) algorithm for the optimal online economic dispatch strategy in VPPs. By utilizing DRL, our proposed algorithm reduced the computational complexity while also incorporating large and continuous state space due to the stochastic characteristics of distributed power generation. We further design an edge computing framework to handle the stochastic and large-state space characteristics of VPPs. The DRL-based real-time economic dispatch algorithm is executed online. We utilize real meteorological and load data to analyze and validate the performance of our proposed algorithm. The experimental results show that our proposed DRL-based algorithm can successfully learn the characteristics of DGs and industrial user demands. It can learn to choose actions to minimize the cost of VPPs. Compared with the deterministic policy gradient algorithm and DDPG, our proposed method has lower time complexity.

Original languageEnglish
Article number8957677
Pages (from-to)6288-6301
Number of pages14
JournalIEEE Internet of Things Journal
Volume7
Issue number7
DOIs
Publication statusPublished - 2020 Jul

Keywords

  • Deep reinforcement learning (DRL)
  • distributed generation
  • economic dispatch
  • edge computing
  • virtual power plants (VPPs)

ASJC Scopus subject areas

  • Signal Processing
  • Information Systems
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Deep Reinforcement Learning for Economic Dispatch of Virtual Power Plant in Internet of Energy'. Together they form a unique fingerprint.

  • Cite this