TY - GEN
T1 - A Cross-Dimensional Attention Discriminating Masked Method for Building Energy Time-Series Data Imputation
AU - Pei, Jialong
AU - Ma, Jieming
AU - Man, Ka Lok
AU - Zhao, Chun
AU - Tian, Zhongbei
N1 - Publisher Copyright:
© 2024 University of Split, FESB.
PY - 2024
Y1 - 2024
N2 - Missing data in building energy time series is a pervasive issue, which leads to data format inconsistencies and hindrances in energy prediction and management. The most common approach to addressing missing data in building energy data is through data imputation. The critical challenge of data imputation is ensuring that the imputed data closely approximates the real values. This paper proposes a Cross-Dimensional Attention Discriminating Masked (CDADM) method, which modifies the self-attention model. The CDADM method captures essential global information about missing values through the cross-dimensional attention mechanism. Meanwhile, the discriminating attention mask mechanism enhances the ability to extract dependencies in long sequence data. Experimental results on typical building energy consumption data demonstrate that our proposed model is better than existing data imputation methods and shows the generality of the CDADM model.
AB - Missing data in building energy time series is a pervasive issue, which leads to data format inconsistencies and hindrances in energy prediction and management. The most common approach to addressing missing data in building energy data is through data imputation. The critical challenge of data imputation is ensuring that the imputed data closely approximates the real values. This paper proposes a Cross-Dimensional Attention Discriminating Masked (CDADM) method, which modifies the self-attention model. The CDADM method captures essential global information about missing values through the cross-dimensional attention mechanism. Meanwhile, the discriminating attention mask mechanism enhances the ability to extract dependencies in long sequence data. Experimental results on typical building energy consumption data demonstrate that our proposed model is better than existing data imputation methods and shows the generality of the CDADM model.
KW - building energy consumption
KW - energy efficiency
KW - missing value imputation
KW - multivariate time series
KW - self-attention
KW - transformer
UR - http://www.scopus.com/inward/record.url?scp=85202449542&partnerID=8YFLogxK
U2 - 10.23919/SpliTech61897.2024.10612589
DO - 10.23919/SpliTech61897.2024.10612589
M3 - Conference Proceeding
AN - SCOPUS:85202449542
T3 - 2024 9th International Conference on Smart and Sustainable Technologies, SpliTech 2024
BT - 2024 9th International Conference on Smart and Sustainable Technologies, SpliTech 2024
A2 - Solic, Petar
A2 - Nizetic, Sandro
A2 - Rodrigues, Joel J. P. C.
A2 - Rodrigues, Joel J.P.C.
A2 - Gonzalez-de-Artaza, Diego Lopez-de-Ipina
A2 - Perkovic, Toni
A2 - Catarinucci, Luca
A2 - Patrono, Luigi
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 9th International Conference on Smart and Sustainable Technologies, SpliTech 2024
Y2 - 25 June 2024 through 28 June 2024
ER -