TY - JOUR
T1 - Developing Purely Data-Driven Multi-Mode Process Controllers Using Inverse Reinforcement Learning
AU - Lin, Runze
AU - Chen, Junghui
AU - Huang, Biao
AU - Xie, Lei
AU - Su, Hongye
N1 - Publisher Copyright:
© 2024 Elsevier B.V.
PY - 2024/1
Y1 - 2024/1
N2 - In recent years, process control researchers have been paying close attention to Deep Reinforcement Learning (DRL). DRL offers the potential for model-free controller design, but it is challenging to achieve satisfactory outcomes without accurate simulation models and well-designed reward functions, particularly in multi-mode processes. To address this issue, this paper presents a novel approach that combines inverse RL (IRL) and multi-task learning to provide a purely data-driven solution for multi-mode control design, allowing for transfer learning and adaptation in different operating modes. The effectiveness of this novel approach is demonstrated through a CSTR continuous control case using multi-mode historical closed-loop data. The proposed method offers a promising solution to the challenges of designing controllers for multi-mode processes.
AB - In recent years, process control researchers have been paying close attention to Deep Reinforcement Learning (DRL). DRL offers the potential for model-free controller design, but it is challenging to achieve satisfactory outcomes without accurate simulation models and well-designed reward functions, particularly in multi-mode processes. To address this issue, this paper presents a novel approach that combines inverse RL (IRL) and multi-task learning to provide a purely data-driven solution for multi-mode control design, allowing for transfer learning and adaptation in different operating modes. The effectiveness of this novel approach is demonstrated through a CSTR continuous control case using multi-mode historical closed-loop data. The proposed method offers a promising solution to the challenges of designing controllers for multi-mode processes.
KW - data-driven controller design
KW - inverse reinforcement learning
KW - multi-mode process control
KW - multi-task reinforcement learning
UR - https://www.scopus.com/pages/publications/85196364098
U2 - 10.1016/B978-0-443-28824-1.50456-7
DO - 10.1016/B978-0-443-28824-1.50456-7
M3 - Article
AN - SCOPUS:85196364098
SN - 1570-7946
VL - 53
SP - 2731
EP - 2736
JO - Computer Aided Chemical Engineering
JF - Computer Aided Chemical Engineering
ER -