Spatio-temporal graph-based CNNs for anomaly detection in weakly-labeled videos

作者:

Highlights:

• Spatial similarity graph and temporal consistency graph are constructed, and the attention mechanism is introduced to allocate attention for each segment.

• A novel spatial-temporal fusion graph module is proposed to capture the corresponding identifying information synchronously, and long-range spatial-temporal dependencies could also be extracted with layers stacked.

• We formulate a ranking loss which encourages the STGCNs to pay attention to the context around the anomalous part, and a classification loss to adapt the variation of raw videos and less abnormal events.

• We evaluate the proposed method on several anomaly detection benchmarks and it achieves excellent performance as compared to the state-of-the-art anomaly detection works.

摘要

•Spatial similarity graph and temporal consistency graph are constructed, and the attention mechanism is introduced to allocate attention for each segment.•A novel spatial-temporal fusion graph module is proposed to capture the corresponding identifying information synchronously, and long-range spatial-temporal dependencies could also be extracted with layers stacked.•We formulate a ranking loss which encourages the STGCNs to pay attention to the context around the anomalous part, and a classification loss to adapt the variation of raw videos and less abnormal events.•We evaluate the proposed method on several anomaly detection benchmarks and it achieves excellent performance as compared to the state-of-the-art anomaly detection works.

论文关键词:Anomaly detection,Attention mechanism,Graph convolutional networks,Spatio-temporal features,Weakly supervised learning

论文评审过程:Received 23 December 2021, Revised 22 April 2022, Accepted 14 May 2022, Available online 26 May 2022, Version of Record 26 May 2022.

论文官网地址:https://doi.org/10.1016/j.ipm.2022.102983