Image Reconstruction via Manifold Constrained Convolutional Sparse Coding for Image Sets

Yang, Linlin and Li, Ce and Han, Jungong and Chen, Chen and Ye, Qixiang and Zhang, Baochang and Cao, Xianbin and Liu, Wanquan (2017) Image Reconstruction via Manifold Constrained Convolutional Sparse Coding for Image Sets. IEEE Journal of Selected Topics in Signal Processing. ISSN 1932-4553

[thumbnail of LinlinIEEESTSP]
LinlinIEEESTSP.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (2MB)


Convolution sparse coding (CSC) has attracted much attention recently due to its advantages in image reconstruction and enhancement. However, the coding process suffers from perturbations caused by variations of input samples, as the consistence of features from similar input samples are not well addressed in the existing literature. In this paper, we will tackle this feature consistence problem from a set of samples via a proposed manifold constrained convolutional sparse coding (MCSC) method. The core idea of MCSC is to use the intrinsic manifold (Laplacian) structure of the input data to regularize the traditional CSC such that the consistence between features extracted from input samples can be well preserved. To implement the proposed MCSC method efficiently, the alternating direction method of multipliers (ADMM) approach is employed, which can consistently integrate the underlying Laplacian constraints during the optimization process. With this regularized data structure constraint, the MCSC can achieve a much better solution which is robust to the variance of the input samples against over-complete filters. We demonstrate the capacity of MCSC by providing the state-of-the-art results when applied it to the task of reconstructing light fields. Finally, we show that the proposed MCSC is a generic approach as it also achieves better results than the state-of-the-art approaches based on convolutional sparse coding in other image reconstruction tasks, such as face reconstruction, digit reconstruction and image restoration.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Journal of Selected Topics in Signal Processing
Additional Information:
©2017 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? signal processingelectrical and electronic engineering ??
ID Code:
Deposited By:
Deposited On:
20 Sep 2017 15:02
Last Modified:
18 Dec 2023 01:48