TY - JOUR
T1 - A Novel Deep Reinforcement Learning Based Method for Real-time Pricing and Scheduling in Electric Vehicle Charging Stations
AU - Mu, Qijian
AU - Chu, Wen
AU - Chen, Cheng
AU - Zhang, Yaxin
AU - Liu, Guizhen
AU - Wang, Yifei
AU - Bo, Yunfei
AU - Xu, Xu
N1 - Publisher Copyright:
© The Institution of Engineering & Technology 2024.
PY - 2024
Y1 - 2024
N2 - This study introduces an innovative approach using deep reinforcement learning (DRL) algorithms to optimize real-time pricing and scheduling control in electric vehicle (EV) charging stations. Given a set of charging speed options, the objective is to minimize the total charging cost for all vehicles while ensuring each vehicle reaches its required target power. The core problem is formulated as a Markov Decision Process (MDP), where algorithms like Double Deep Q-Network (DDQN) are developed and tested to explore and refine charging strategies, enabling the agent to select the most efficient policy based on the current state. Through a simulated environment, the study evaluates various charging strategies by focusing on metrics such as charging efficiency, cost-effectiveness, user experience, and grid impact. A DRL-based simulation environment and agent were implemented, with parameters like learning rate and exploration rate optimized through iterative training. Results demonstrate that the agent effectively balances exploration and exploitation, achieving stable and high cumulative rewards throughout training. This research significantly contributes to EV charging station operations by enhancing efficiency and profitability while supporting grid stability.
AB - This study introduces an innovative approach using deep reinforcement learning (DRL) algorithms to optimize real-time pricing and scheduling control in electric vehicle (EV) charging stations. Given a set of charging speed options, the objective is to minimize the total charging cost for all vehicles while ensuring each vehicle reaches its required target power. The core problem is formulated as a Markov Decision Process (MDP), where algorithms like Double Deep Q-Network (DDQN) are developed and tested to explore and refine charging strategies, enabling the agent to select the most efficient policy based on the current state. Through a simulated environment, the study evaluates various charging strategies by focusing on metrics such as charging efficiency, cost-effectiveness, user experience, and grid impact. A DRL-based simulation environment and agent were implemented, with parameters like learning rate and exploration rate optimized through iterative training. Results demonstrate that the agent effectively balances exploration and exploitation, achieving stable and high cumulative rewards throughout training. This research significantly contributes to EV charging station operations by enhancing efficiency and profitability while supporting grid stability.
KW - deep reinforcement learning
KW - electric vehicle charging station
KW - real-time pricing
KW - scheduling
UR - http://www.scopus.com/inward/record.url?scp=105004170486&partnerID=8YFLogxK
U2 - 10.1049/icp.2025.0727
DO - 10.1049/icp.2025.0727
M3 - Conference article
AN - SCOPUS:105004170486
SN - 2732-4494
VL - 2024
SP - 1407
EP - 1412
JO - IET Conference Proceedings
JF - IET Conference Proceedings
IS - 33
T2 - 4th Energy Conversion and Economics Annual Forum, ECE Forum 2024
Y2 - 14 December 2024 through 15 December 2024
ER -