Developing Purely Data-Driven Multi-Mode Process Controllers Using Inverse Reinforcement Learning

Runze Lin, Junghui Chen, Biao Huang, Lei Xie, Hongye Su

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

In recent years, process control researchers have been paying close attention to Deep Reinforcement Learning (DRL). DRL offers the potential for model-free controller design, but it is challenging to achieve satisfactory outcomes without accurate simulation models and well-designed reward functions, particularly in multi-mode processes. To address this issue, this paper presents a novel approach that combines inverse RL (IRL) and multi-task learning to provide a purely data-driven solution for multi-mode control design, allowing for transfer learning and adaptation in different operating modes. The effectiveness of this novel approach is demonstrated through a CSTR continuous control case using multi-mode historical closed-loop data. The proposed method offers a promising solution to the challenges of designing controllers for multi-mode processes.

Original languageEnglish
Pages (from-to)2731-2736
Number of pages6
JournalComputer Aided Chemical Engineering
Volume53
DOIs
Publication statusPublished - Jan 2024
Externally publishedYes

Keywords

  • data-driven controller design
  • inverse reinforcement learning
  • multi-mode process control
  • multi-task reinforcement learning

Fingerprint

Dive into the research topics of 'Developing Purely Data-Driven Multi-Mode Process Controllers Using Inverse Reinforcement Learning'. Together they form a unique fingerprint.

Cite this