Learning image compressed sensing with sub-pixel convolutional generative adversarial network

作者:

Highlights:

• The proposed SCGAN learns an explicit mapping from the compressed measurement to the reconstruction in an adversarial manner, thereby the reconstruction to any testing sample can be obtained by simply feeding the measurement vector into the well-trained generator, improving significantly the reconstruction quality and speeding up the CS reconstruction procedure greatly.

• Our generator network uses multiple sub-pixel convolutions to progressively upscale the dimension of feature maps until reaching the dimension of the original image. The sub-pixel convolutions can extract more feature maps for resolution upscaling and thus promote the reconstruction quality.

• We design a compound loss function, consisting of CS task-oriented reconstruction loss, measurement loss term and Wasserstein adversarial loss term, to encourage the output of generator to have a similar statistical distribution as the real images.

摘要

•The proposed SCGAN learns an explicit mapping from the compressed measurement to the reconstruction in an adversarial manner, thereby the reconstruction to any testing sample can be obtained by simply feeding the measurement vector into the well-trained generator, improving significantly the reconstruction quality and speeding up the CS reconstruction procedure greatly.•Our generator network uses multiple sub-pixel convolutions to progressively upscale the dimension of feature maps until reaching the dimension of the original image. The sub-pixel convolutions can extract more feature maps for resolution upscaling and thus promote the reconstruction quality.•We design a compound loss function, consisting of CS task-oriented reconstruction loss, measurement loss term and Wasserstein adversarial loss term, to encourage the output of generator to have a similar statistical distribution as the real images.

论文关键词:Compressed sensing,Sub-pixel convolutional GAN,Compound loss

论文评审过程:Received 9 January 2019, Revised 22 August 2019, Accepted 12 September 2019, Available online 13 September 2019, Version of Record 4 October 2019.

论文官网地址:https://doi.org/10.1016/j.patcog.2019.107051