A Novel Deep Reinforcement Learning Based Method for Real-time Pricing and Scheduling in Electric Vehicle Charging Stations

Qijian Mu, Wen Chu, Cheng Chen, Yaxin Zhang*, Guizhen Liu, Yifei Wang, Yunfei Bo, Xu Xu

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

Abstract

This study introduces an innovative approach using deep reinforcement learning (DRL) algorithms to optimize real-time pricing and scheduling control in electric vehicle (EV) charging stations. Given a set of charging speed options, the objective is to minimize the total charging cost for all vehicles while ensuring each vehicle reaches its required target power. The core problem is formulated as a Markov Decision Process (MDP), where algorithms like Double Deep Q-Network (DDQN) are developed and tested to explore and refine charging strategies, enabling the agent to select the most efficient policy based on the current state. Through a simulated environment, the study evaluates various charging strategies by focusing on metrics such as charging efficiency, cost-effectiveness, user experience, and grid impact. A DRL-based simulation environment and agent were implemented, with parameters like learning rate and exploration rate optimized through iterative training. Results demonstrate that the agent effectively balances exploration and exploitation, achieving stable and high cumulative rewards throughout training. This research significantly contributes to EV charging station operations by enhancing efficiency and profitability while supporting grid stability.

Original languageEnglish
Pages (from-to)1407-1412
Number of pages6
JournalIET Conference Proceedings
Volume2024
Issue number33
DOIs
Publication statusPublished - 2024
Event4th Energy Conversion and Economics Annual Forum, ECE Forum 2024 - Beijing, China
Duration: 14 Dec 202415 Dec 2024

Keywords

  • deep reinforcement learning
  • electric vehicle charging station
  • real-time pricing
  • scheduling

Fingerprint

Dive into the research topics of 'A Novel Deep Reinforcement Learning Based Method for Real-time Pricing and Scheduling in Electric Vehicle Charging Stations'. Together they form a unique fingerprint.

Cite this