JSPNet: Learning joint semantic & instance segmentation of point clouds via feature self-similarity and cross-task probability

作者:

Highlights:

• To our best knowledge, the common ground of mutual promotion and conflict in joint semantic and instance segmentation are firstly analyzed in detail in this work.

• The similarity-based feature fusion module could maintain discriminative features and characterize inconspicuous content.

• The cross-task probability-based feature fusion module could model the task-relatedness by establishing probabilistic correlation between semantic and instance features.

• The proposed method significantly outperforms state-of-the-arts in both semantic and instance segmentation on two benchmarks.

摘要

•To our best knowledge, the common ground of mutual promotion and conflict in joint semantic and instance segmentation are firstly analyzed in detail in this work.•The similarity-based feature fusion module could maintain discriminative features and characterize inconspicuous content.•The cross-task probability-based feature fusion module could model the task-relatedness by establishing probabilistic correlation between semantic and instance features.•The proposed method significantly outperforms state-of-the-arts in both semantic and instance segmentation on two benchmarks.

论文关键词:Instance & semantic segmentation,Point could processing,Multi-task learning

论文评审过程:Received 12 September 2020, Revised 9 August 2021, Accepted 11 August 2021, Available online 13 August 2021, Version of Record 24 August 2021.

论文官网地址:https://doi.org/10.1016/j.patcog.2021.108250