TY - GEN
T1 - A SCENE-ADAPTIVE FRAMEWORK FOR POSE-ORIENTED ABNORMAL EVENT DETECTION
AU - Yang, Yuxing
AU - Fu, Zeyu
AU - Naqvi, Syed Mohsen
N1 - Publisher Copyright:
© 2023 European Signal Processing Conference, EUSIPCO. All rights reserved.
PY - 2023
Y1 - 2023
N2 - For intelligent surveillance systems, abnormal event detection (AED) automatically analyses monitoring video sequences and detects abnormal objects or strange human actions at the frame level. Due to the shortage of labelled data, most approaches for AED are based on reconstruction or prediction models in a semi-surprised manner. However, these methods may not generalize well to an unseen scene context. To address this, we present a pose-oriented scene-adaptive framework for AED. In this framework, we propose synergistic pose estimation and object detection, which integrates human poses and object detection information well to improve pose information accuracy. Subsequently, the enhanced pose sequences are taken into a spatial-temporal graph convolutional network to extract the geometric features. Finally, the features are embedded in a clustering layer to classify the type of actions and calculate the normality scores. For evaluation, the proposed framework is tested on video sequences with unseen scene context across from UCSD PED1 & PED2 and ShanghaiTech Campus datasets. The performance analysis and the results compared with other state-of-the-art works confirm the robustness and effectiveness of our proposed framework for cross-scene AED.
AB - For intelligent surveillance systems, abnormal event detection (AED) automatically analyses monitoring video sequences and detects abnormal objects or strange human actions at the frame level. Due to the shortage of labelled data, most approaches for AED are based on reconstruction or prediction models in a semi-surprised manner. However, these methods may not generalize well to an unseen scene context. To address this, we present a pose-oriented scene-adaptive framework for AED. In this framework, we propose synergistic pose estimation and object detection, which integrates human poses and object detection information well to improve pose information accuracy. Subsequently, the enhanced pose sequences are taken into a spatial-temporal graph convolutional network to extract the geometric features. Finally, the features are embedded in a clustering layer to classify the type of actions and calculate the normality scores. For evaluation, the proposed framework is tested on video sequences with unseen scene context across from UCSD PED1 & PED2 and ShanghaiTech Campus datasets. The performance analysis and the results compared with other state-of-the-art works confirm the robustness and effectiveness of our proposed framework for cross-scene AED.
KW - Abnormal event detection
KW - graph convolutions
KW - object detection
KW - pose estimation
KW - scene-adaptive
UR - http://www.scopus.com/inward/record.url?scp=85178321820&partnerID=8YFLogxK
U2 - 10.23919/EUSIPCO58844.2023.10289739
DO - 10.23919/EUSIPCO58844.2023.10289739
M3 - Conference Proceeding
AN - SCOPUS:85178321820
T3 - European Signal Processing Conference
SP - 521
EP - 525
BT - 31st European Signal Processing Conference, EUSIPCO 2023 - Proceedings
PB - European Signal Processing Conference, EUSIPCO
T2 - 31st European Signal Processing Conference, EUSIPCO 2023
Y2 - 4 September 2023 through 8 September 2023
ER -