دورية أكاديمية

Voltage Control-Based Ancillary Service Using Deep Reinforcement Learning

التفاصيل البيبلوغرافية
العنوان: Voltage Control-Based Ancillary Service Using Deep Reinforcement Learning
المؤلفون: Oleh Lukianykhin, Tetiana Bogodorova
المصدر: Energies, Vol 14, Iss 8, p 2274 (2021)
بيانات النشر: MDPI AG, 2021.
سنة النشر: 2021
المجموعة: LCC:Technology
مصطلحات موضوعية: power system, deep reinforcement learning, demand response, python, Modelica, open AI gym, Technology
الوصف: Ancillary services rely on operating reserves to support an uninterrupted electricity supply that meets demand. One of the hidden reserves of the grid is in thermostatically controlled loads. To efficiently exploit these reserves, a new realization of control of voltage in the allowable range to follow the set power reference is proposed. The proposed approach is based on the deep reinforcement learning (RL) algorithm. Double DQN is utilized because of the proven state-of-the-art level of performance in complex control tasks, native handling of continuous environment state variables, and model-free application of the trained DDQN to the real grid. To evaluate the deep RL control performance, the proposed method was compared with a classic proportional control of the voltage change according to the power reference setup. The solution was validated in setups with a different number of thermostatically controlled loads (TCLs) in a feeder to show its generalization capabilities. In this article, the particularities of deep reinforcement learning application in the power system domain are discussed along with the results achieved by such an RL-powered demand response solution. The tuning of hyperparameters for the RL algorithm was performed to achieve the best performance of the double deep Q-network (DDQN) algorithm. In particular, the influence of a learning rate, a target network update step, network hidden layer size, batch size, and replay buffer size were assessed. The achieved performance is roughly two times better than the competing approach of optimal control selection within the considered time interval of the simulation. The decrease in deviation of the actual power consumption from the reference power profile is demonstrated. The benefit in costs is estimated for the presented voltage control-based ancillary service to show the potential impact.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 1996-1073
Relation: https://www.mdpi.com/1996-1073/14/8/2274; https://doaj.org/toc/1996-1073
DOI: 10.3390/en14082274
URL الوصول: https://doaj.org/article/803da87d983f42e997a3ac404c1c2a43
رقم الأكسشن: edsdoj.803da87d983f42e997a3ac404c1c2a43
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:19961073
DOI:10.3390/en14082274