DeLELSTM: Decomposition-based Linear Explainable LSTM to Capture Instantaneous and Long-term Effects in Time Series

Chaoqun Wang, Yijun Li, Xiangqian Sun, Qi Wu

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

Abstract

Time series forecasting is prevalent in various real-world applications. Despite the promising results of deep learning models in time series forecasting, especially the Recurrent Neural Networks (RNNs), the explanations of time series models, which are critical in high-stakes applications, have received little attention. In this paper, we propose a Decomposition-based Linear Explainable LSTM (DeLELSTM) to improve the interpretability of LSTM. Conventionally, the interpretability of RNNs only concentrates on the variable importance and time importance. We additionally distinguish between the instantaneous influence of new coming data and the long-term effects of historical data. Specifically, DeLELSTM consists of two components, ie, standard LSTM and tensorized LSTM. The tensorized LSTM assigns each variable with a unique hidden state making up a matrix h t, and the standard LSTM models all the variables with a shared hidden state H t. By decomposing the H t into the linear combination of past information h t− 1 and the fresh information h t− h t− 1, we can get the instantaneous influence and the long-term effect of each variable. In addition, the advantage of linear regression also makes the explanation transparent and clear. We demonstrate the effectiveness and interpretability of DeLELSTM on three empirical datasets. Extensive experiments show that the proposed method achieves competitive performance against the baseline methods and provides a reliable explanation relative to domain knowledge.
Original languageEnglish
Title of host publicationInternational Joint Conference on Artificial Intelligence
Pages4299-4307
Volume2023-August
DOIs
Publication statusPublished - 2023

Fingerprint

Dive into the research topics of 'DeLELSTM: Decomposition-based Linear Explainable LSTM to Capture Instantaneous and Long-term Effects in Time Series'. Together they form a unique fingerprint.

Cite this