Human object interaction detection using two-direction spatial enhancement and exclusive object prior

作者:

Highlights:

• One of the significant problems in HOI detection is mis-grouping, which is no interaction human-object pair can be easily mis-grouped and misclassified as an action.

• To suppress the no interaction human-object pairs, we propose a spatial enhancement approach to enforce fine-level spatial constraints in two directions between human body parts and object parts.

• At inference, we propose a human-object regrouping approach for object- exclusive actions by considering the object-exclusive property of the interactive object, where the target object should not be shared by more than one human.

摘要

•One of the significant problems in HOI detection is mis-grouping, which is no interaction human-object pair can be easily mis-grouped and misclassified as an action.•To suppress the no interaction human-object pairs, we propose a spatial enhancement approach to enforce fine-level spatial constraints in two directions between human body parts and object parts.•At inference, we propose a human-object regrouping approach for object- exclusive actions by considering the object-exclusive property of the interactive object, where the target object should not be shared by more than one human.

论文关键词:Human-object interaction detection,Two-direction spatial enhancement,Exclusive object prior,Mis-grouped human-object pairs,Non-interactive suppression

论文评审过程:Received 8 September 2020, Revised 13 June 2021, Accepted 16 November 2021, Available online 24 November 2021, Version of Record 3 December 2021.

论文官网地址:https://doi.org/10.1016/j.patcog.2021.108438