Deep multi-level fusion network for multi-source image pixel-wise classification

作者:

Highlights:

摘要

For multi-source image pixel-wise classification, each image information is different and complementary in the same area or scene. However, how to integrate them for decision-making is a difficult problem. In this paper, we focus on the characteristics of multi-source image and propose a novel pixel-wise classification method, named deep multi-level fusion network. The proposed method is to classify multi-sensor data including very high-resolution (VHR) RGB imagery, hyperspectral imagery (HSI) and multispectral light detection and ranging (MS-LiDAR) point cloud data. First, a deep spectral–spatial attention network is proposed to process HSI and MS-LiDAR images and get a learned classification map, which is based on feature level fusion. Next, a down-superpixel segmentation algorithm is proposed to get a segmentation result for VHR RGB imagery. Finally, the feature level fusion results are refinement by the down-superpixel segmentation results on the decision level, and get the final result. Extensive experiments and analyses on the data set demonstrate that the proposed multi-level fusion network can achieve a better result in the multi-source image pixel-wise classification.

论文关键词:Classification,Multi-level fusion,Attention,Segmentation

论文评审过程:Received 24 September 2020, Revised 26 January 2021, Accepted 2 March 2021, Available online 19 March 2021, Version of Record 22 March 2021.

论文官网地址:https://doi.org/10.1016/j.knosys.2021.106921