Dual attention-based method for occluded person re-identification

作者:

Highlights:

摘要

Occlusion is unavoidable in real-world applications of person re-identification (ReID). To alleviate the occlusion problem, this work proposes the detection of the occluded and visible regions of the human body by suppressing the occluded region during feature generation and matching, and enhancing the significance of the visible region. This paper introduces a novel method based on pose-guided spatial attention (PGSA) and activation-based attention (AA) called dual-attention re-identification (DAReID). DAReID consists of a mask branch and a global branch and uses ResNet-50 as the backbone network. The mask branch uses PGSA to obtain the visible and occluded regions of a person and constructs pose guided coarse labels for the occluded region through keypoints of the human body, driving the network to obtain robust local features. The global branch obtains the visual activation levels of different regions through AA, and combines this with human pose information to define weighted local distances(WLD). The WLD learning strategy is applied to drive the network to learn new and more discriminative local features. Experimental results show that DAReID achieves comparable performance on the Market1501, DukeMTMC-reID, and CUHK-03 datasets. And on the Occluded-DukeMTMC dataset, DAReID outperforms the existing methods.

论文关键词:Person ReID,Deep learning,Image retrieval

论文评审过程:Received 21 May 2020, Revised 17 October 2020, Accepted 20 October 2020, Available online 11 November 2020, Version of Record 24 December 2020.

论文官网地址:https://doi.org/10.1016/j.knosys.2020.106554