GMM priors for image correlations

No Thumbnail Available
Date
2018
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Patch based image restoration algorithms split a given degraded and/or noisy input image into the set of all possible overlapping patches, separately restore each of the patches, and finally compute the restored image by aggregating all the restored overlapping patches. Patch based algorithms exploit various types of patch priors to regularize the ill-posed inverse problems arising in commonly encountered image restoration problems. Patch priors encapsulate the essential characteristics typically exhibited by natural image patches. Recently, patch based image restoration algorithms exploiting Gaussian Mixture Models (GMMS) as a patch prior have been shown to produce impressive results in various image restoration problems. Recent works have also established the close connections between image restoration algorithms exploiting GMM priors, and the widely studied sparse representation or sparsity priors characterizing natural image patches. These works have proposed GMM analogues of several image restoration algorithms exploiting the sparsity prior. The GMM analogues generally offer superior performance, and are computationally faster when compared with the sparsity based algorithms. In previous works, sparsity priors have also been shown to be good at jointly characterizing highly correlated natural image patches arising in certain image restoration problems such as Single Image Super Resolution (SISR) and color image restoration. In the case of SISR problem, a High Resolution (HR) patch and the corresponding Low Resolution (LR) patch are highly correlated as they differ only in scale. Similarly, the corresponding patches from different color channels, i.e., the patches around a common patch center, but from different color channels of a color image are generally observed to be highly correlated. In the literature, SISR algorithms exploiting sparsity prior for jointly characterizing the correlated HR-LR patch pairs, and color image restoration algorithms exploiting sparsity prior for jointly characterizing the corresponding patches from different color channels, have been demonstrated to achieve state of the art performance. However, joint characterization of correlated natural image patches using GMMS has not been previously studied in the literature. In this thesis, we investigate the potential of GMMS in jointly characterizing highly correlated natural image patches.
Description
Supervisor: Tony Jacob
Keywords
ELECTRONICS AND ELECTRICAL ENGINEERING
Citation