Optimization for Interval Type-2 Polynomial Fuzzy Systems: A Deep Reinforcement Learning Approach

Bo Xiao, Hak Keung Lam*, Chengbin Xuan, Ziwei Wang, Eric M. Yeatman

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)

Abstract

It is known that the interval type-2 (IT2) fuzzy controllers are superior compared to their type-1 counterparts in terms of robustness, flexibility, etc. However, how to conduct the type reduction optimally with the consideration of system stability under the fuzzy-model-based (FMB) control framework is still an open problem. To address this issue, we present a new approach through the membership-function-dependent (MFD) and deep reinforcement learning approaches. In the proposed approach, the reduction of IT2 membership functions of the fuzzy controller is completing during optimizing the control performance. Another fundamental issue is that the stability conditions must hold subject to different type-reduction methods. It is tedious and impractical to resolve the stability conditions according to different type-reduction methods, which could lead to infinite possibility. It is more practical to guarantee the holding of stability conditions during type-reduction rather than resolving the stability conditions, the MFD approach is proposed with the imperfect premise matching concept. Thanks to the unique merit of the MFD approach, the stability conditions according to all the different embedded type-1 membership functions within the footprint of uncertainty are guaranteed to be valid. During the control processes, the state transitions associated with properly engineered cost/reward function can be used to approximately calculate the deterministic policy gradient to optimize the acting policy and then to improve the control performance through determining the grade of IT2 membership functions of the fuzzy controller. The detailed simulation example is provided to verify the merits of the proposed approach.

Original languageEnglish
Pages (from-to)1269-1280
Number of pages12
JournalIEEE Transactions on Artificial Intelligence
Volume4
Issue number5
DOIs
Publication statusPublished - 1 Oct 2023
Externally publishedYes

Keywords

  • Deep reinforcement learning (DRL)
  • fuzzy con- trol
  • imperfect premise matching (IPM)
  • interval type-2 (IT2) fuzz sets
  • membership-function-dependent (MFD) approach
  • sum-of-squares (SOS)

Fingerprint

Dive into the research topics of 'Optimization for Interval Type-2 Polynomial Fuzzy Systems: A Deep Reinforcement Learning Approach'. Together they form a unique fingerprint.

Cite this