×

Color image restoration and inpainting via multi-channel total curvature. (English) Zbl 1460.94014

Summary: The multi-channel total variation (MTV) based on L2 norm is capable of preserving object edges and smoothing flat regions in color images. However, it will lead to loss of image contrast, smear object corners, and produce staircase artifacts in the restored images. In order to remedy these side effects, we propose a new multi-channel total curvature model based on L1 norm (MTC-L1) for vector-valued image restoration in this paper. By introducing some auxiliary variables and Lagrange multipliers, we develop a fast algorithm based alternating direction method of multipliers (ADMM) for the proposed model, which allows the use of the fast Fourier transform (FFT), generalized soft threshold formulas and projection method. Extensive experiments have been conducted on both synthetic and real color images, which validate the proposed approach for better restoration performance, and show advantages of the proposed ADMM over algorithms based on traditional gradient descent method (GDM) in terms of computational efficiency.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
94A40 Channel models (including quantum) in information and communication theory
65T50 Numerical methods for discrete and fast Fourier transforms
42A38 Fourier and Fourier-Stieltjes transforms and other transforms of Fourier type

Software:

RecPF
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Chan, T. F.; Shen, J., Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods (2005), SIAM · Zbl 1095.68127
[2] Aubert, G.; Kornprobst, P., Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations (2006), Springer Science & Business Media · Zbl 1110.35001
[3] (Paragios, N.; Chen, Y.; Faugeras, O., Handbook of Mathematical Models in Computer Vision (2006), Springer Science & Business Media) · Zbl 1083.68500
[4] (Scherzer, O., Handbook of Mathematical Methods in Imaging (2010), Springer Science & Business Media)
[5] Rudin, L.; Osher, S.; Fatemi, E., Nonlinear total variation based noise removal algorithms, Physica D, 60, 1-4, 259-268 (1992) · Zbl 0780.49028
[6] Alliney, S., Digital filters as absolute norm regularizers, IEEE Trans. Signal Process., 40, 6, 1548-1562 (1992) · Zbl 0859.93037
[7] Alliney, S., A property of the minimum vectors of a regularizing functional defined by means of the absolute norm, IEEE Trans. Signal Process., 45, 4, 913-917 (1997)
[8] Nikolova, M., Minimizers of cost-functions involving nonsmooth data-fidelity terms: application to the processing of outliers, SIAM J. Numer. Anal., 40, 3, 965-994 (2002) · Zbl 1018.49025
[9] Chan, T. F.; Esedoglu, S., Aspects of total variation regularized L1 function approximation, SIAM J. Appl. Math., 65, 5, 1817-1837 (2005) · Zbl 1096.94004
[10] Lysaker, M.; Lundervold, A.; Tai, X. C., Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time, IEEE Trans. Image Process., 12, 12, 1579-1590 (2003) · Zbl 1286.94020
[11] Chambolle, A.; Lions, P.-L., Image recovery via total variation minimization and related problems, Numer. Math., 76, 2, 167-188 (1997) · Zbl 0874.68299
[12] Bredies, K.; Kunisch, K.; Pock, T., Total generalized variation, SIAM J. Imaging Sci., 3, 3, 492-526 (2010) · Zbl 1195.49025
[13] Chan, T. F.; Marquina, A.; Mulet, P., High-order total variation-based image restoration, SIAM J. Sci. Comput., 22, 2, 503-516 (2000) · Zbl 0968.68175
[14] Zhu, W.; Chan, T. F., Image denoising using mean curvature of image surface, SIAM J. Imaging Sci., 5, 1, 1-32 (2012) · Zbl 1258.94021
[15] Yip, A. M.; Zhu, W., A fast modified Newton’s method for curvature based denoising of 1D signals, Inverse Probl. Imaging, 7, 3, 1075-1097 (2013) · Zbl 1272.68449
[16] Chan, T. F.; Kang, S. H.; Shen, J., Euler’s elastica and curvature-based inpainting, SIAM J. Appl. Math., 63, 2, 564-592 (2002) · Zbl 1028.68185
[17] Masnou, S.; Morel, J., Level-lines based disocclusion, (Proceedings of the IEEE International Conference on Image Processing, 3 (1998)), 259-263
[18] Chan, T. F., Nontexture inpainting by curvature-driven diffusions, J. Vis. Commun. Image Represent., 12, 4, 436-449 (2001)
[19] Esedoglu, S.; Shen, J., Digital inpainting by the Mumford-Shah-Euler image model, Eur. J. Appl. Math., 13, 4, 353-370 (2002) · Zbl 1017.94505
[20] Nitzberg, M.; Mumford, D., The 2.1-D sketch, (Proceedings of IEEE Third International Conference on Computer Vision (1990)), 138-144
[21] Zhu, W.; Chan, T. F.; Esedoglu, S., Segmentation with depth: a level set approach, SIAM J. Sci. Comput., 28, 5, 1957-1973 (2006) · Zbl 1344.68266
[22] Kang, S. H.; Zhu, W.; Shen, J., Illusory shapes via corner fusion, SIAM J. Imaging Sci., 7, 4, 1907-1936 (2014) · Zbl 1320.68217
[23] Blomgren, P.; Chan, T. F., Color TV: total variation methods for restoration of vector-valued images, IEEE Trans. Image Process., 7, 3, 304-309 (1998)
[24] Sapiro, G.; Ringach, D. L., Anisotropic diffusion of multi-valued images with applications to color filtering, IEEE Trans. Image Process., 5, 11, 1582-1586 (1996)
[25] Brook, A.; Kimmel, R.; Sochen, N., Variational restoration and edge detection for color images, J. Math. Imaging Vis., 18, 3, 247-268 (2003) · Zbl 1020.68079
[26] Tan, L.; Wei, W. B.; Pan, Z. K., A high-order model of TV and its augmented Lagrangian algorithm, Appl. Mech. Mater., 568, 726-733 (2014)
[27] Lv, X. G.; Song, Y. Z.; Wang, S. X., Image restoration with a high-order total variation minimization method, Appl. Math. Model., 37, 16, 8210-8224 (2013) · Zbl 1398.94043
[28] Rosman, G.; Tai, X.-C.; Kimmel, R.; Dascal, L., Polyakov action minimization for efficient color image processing, Trends Top. Comput. Vis., 6554, 50-61 (2012), Lecture Notes in Computer Sciences
[29] Yang, J.; Yin, W.; Zhang, Y.; Wang, Y., A fast algorithm for edge-preserving variational multichannel image restoration, SIAM J. Imaging Sci., 2, 2, 569-592 (2009) · Zbl 1181.68304
[30] Bresson, X.; Chan, T. F., Fast dual minimization of the vectorial total variation norm and applications to color image processing, Inverse Probl. Imaging, 2, 4, 455-484 (2008) · Zbl 1188.68337
[31] Aujol, J. F.; Kang, S. H., Color image decomposition and restoration, J. Vis. Commun. Image Represent., 17, 4, 916-928 (2006)
[32] Duval, V.; Aujol, J. F.; Vese, L. A., A projected gradient algorithm for color image decomposition, Scale Sp. Var. Methods Comput. Vis., 5567, 295-306 (2009), Lecture Notes in Computer Science
[33] Yu, Y.; Pan, Z.; Wei, W.; Jiang, J., Edge preserving of some variational models for vectorial image denoising, Chin. J. Gr. Images, 16, 12, 2223-2230 (2011)
[34] Gilboa, G.; Osher, S., Nonlocal operators with applications to image processing, SIAM Multiscale Model. Simul., 7, 3, 1005-1028 (2008) · Zbl 1181.35006
[35] Jung, M.; Bresson, X.; Chan, T. F.; Vese, L. A., Nonlocal Mumford-Shah regularizers for color image restoration, IEEE Trans. Image Process., 20, 6, 1583-1589 (2011) · Zbl 1372.94124
[36] Duan, J.; Pan, Z.; Liu, W.; Tai, X.-C., Color texture image inpainting using the non-local CTV model, J. Signal Inform. Process., 4, 3b, 43-51 (2013)
[37] Duan, J.; Pan, Z.; Tai, X.-C., Non-local TV models for restoration of color texture images, Chin. J. Image Gr., 18, 7, 753-760 (2013)
[38] Goldstein, T.; O’Donoghue, B.; Setzer, S.; Baraniuk, R., Fast alternating direction optimization methods, SIAM J. Imaging Sci., 7, 3, 1588-1623 (2014) · Zbl 1314.49019
[39] Tai, X.-C.; Hahn, J.; Chung, G. J., A Fast algorithm for Euler’s elastica model using augmented Lagrangian method, SIAM J. Imaging Sci., 4, 1, 313-344 (2011) · Zbl 1215.68262
[40] Wang, Y.; Yang, J.; Yin, W.; Zhang, Y., A new alternating minimization algorithm for total variation image reconstruction, SIAM J. Imaging Sci., 3, 3, 248-272 (2008) · Zbl 1187.68665
[41] Wu, C.; Tai, X.-C., Augmented Lagrangian method, dual methods, and split Bregman iteration for ROF, vectorial TV, and higher order models, SIAM J. Imaging Sci., 3, 3, 300-339 (2010) · Zbl 1206.90245
[42] Goldluecke, B.; Cremers, D., Introducing total curvature for image processing, (Proceedings of the International Conference on Computer Vision, 7 (2011)), 1267-1274
[43] You, Y.-L.; Kaveh, M., Fourth-order partial differential equations for noise removal, IEEE Trans. Image Process., 9, 10, 1723-1730 (2000) · Zbl 0962.94011
[44] Li, F.; Shen, C.; Fang, J.; Shen, C., Image restoration combining a total variational filter and a fourth-order filter, J. Vis. Commun. Image Represent., 18, 4, 322-330 (2007)
[45] Didas, S.; Weickert, J.; Burgeth, B., Properties of higher order nonlinear diffusion filtering, J. Math. Imaging Vis., 35, 3, 208-226 (2009) · Zbl 1490.94011
[46] Chan, T. F.; Esedoglu, S.; Park, F., A fourth order dual method for staircase reduction in texture extraction and image restoration problems, (Proceedings of Seventeenth IEEE International Conference on Image Processing (ICIP), 2010 (2010), IEEE), 4137-4140
[47] Lefkimmiatis, S.; Bourquard, A.; Unser, M., Hessian-based norm regularization for image restoration with biomedical applications, IEEE Trans. Image Process., 21, 3, 983-995 (2012) · Zbl 1372.94145
[48] Papafitsoros, K.; Schönlieb, C. B., A combined first and second order variational approach for image reconstruction, J. Math. Imaging Vis., 48, 2, 308-338 (2014) · Zbl 1362.94009
[49] Lai, R.; Tai, X.-C.; Chan, T. F., A ridge and corner preserving model for surface restoration, SIAM J. Sci. Comput., 35, 2, 675-695 (2013) · Zbl 1266.49080
[50] Zhu, W.; Tai, X.-C.; Chan, T. F., Augmented Lagrangian method for a mean curvature based image denoising model, Inverse Probl. Imaging, 7, 4, 1409-1432 (2013) · Zbl 1311.94015
[51] Tai, X.-C., Fast numerical schemes related to curvature minimization: a brief and elementary review, Actes des rencontres du CIRM, 3, 1, 17-30 (2013) · Zbl 1477.65098
[52] Myllykoski, M.; Glowinski, R.; Karkkainen, T.; Rossi, T., A new augmented Lagrangian approach for L1-mean curvature image denoising, SIAM J. Imaging Sci., 8, 1, 95-125 (2015) · Zbl 1330.94011
[53] Yang, F.; Chen, K.; Yu, B.; Fang, D., A relaxed fixed point method for a mean curvature-based denoising model, Optim. Methods Softw., 29, 2, 274-285 (2014) · Zbl 1284.49039
[54] Tan, L.; Pan, Z.-K; Liu, W.-Q, Image segmentation with depth information via simplified variational level set formulation, J. Math. Imaging Vis., 60, 1, 1-17 (2017) · Zbl 1387.94024
[55] Morel, J. M.; Petro, A. B.; Sbert, C., Screened Poisson equation for image contrast enhancement, Image Process. On Line, 4, 16-29 (2014)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.