Deep Reinforcement Learning Assisted Genetic Programming Ensemble Hyper-Heuristics for Dynamic Scheduling of Container Port Trucks

Xinan Chen, Ruibin Bai, Rong Qu, Jing Dong, Yaochu Jin

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Efficient truck dispatching is crucial for optimizing container terminal operations within dynamic and complex scenarios. Despite good progress being made recently with more advanced uncertainty-handling techniques, existing approaches still have generalization issues and require considerable expertise and manual interventions in algorithm design. In this work, we present deep reinforcement learning-assisted genetic programming hyper-heuristics (DRL-GPHH) and their ensemble variant (DRL-GPEHH). These frameworks utilize a reinforcement learning agent to orchestrate a set of auto-generated genetic programming (GP) low-level heuristics, leveraging the collective intelligence, ensuring advanced robustness and an increased level of automation of the algorithm development. DRL-GPEHH, notably, excels through its concurrent integration of a GP heuristic ensemble, achieving enhanced adaptability and performance in complex, dynamic optimization tasks. This method effectively navigates traditional convergence issues of deep reinforcement learning (DRL) in sparse reward and vast action spaces, while avoiding the reliance on expert-designed heuristics. It also addresses the inadequate performance of the single GP individual in varying and complex environments and preserves the inherent interpretability of the GP approach. Evaluations across various real port operational instances highlight the adaptability and efficacy of our frameworks. Essentially, innovations in DRL-GPHH and DRL-GPEHH reveal the synergistic potential of reinforcement learning and GP in dynamic truck dispatching, yielding transformative impacts on algorithm design and significantly advancing solutions to complex real-world optimization problems.

Original languageEnglish
Pages (from-to)1
Number of pages1
JournalIEEE Transactions on Evolutionary Computation
DOIs
Publication statusAccepted/In press - 2024

Keywords

  • automatic truck dispatching
  • Containers
  • Dispatching
  • dynamic task scheduling
  • genetic programming
  • Heuristic algorithms
  • Marine vehicles
  • Optimization
  • reinforcement learning
  • Reinforcement learning
  • Seaports

Fingerprint

Dive into the research topics of 'Deep Reinforcement Learning Assisted Genetic Programming Ensemble Hyper-Heuristics for Dynamic Scheduling of Container Port Trucks'. Together they form a unique fingerprint.

Cite this