×

Denoising and inpainting of images using TV-type energies: theoretical and computational aspects. (English. Russian original) Zbl 1381.94011

J. Math. Sci., New York 219, No. 6, 899-910 (2016); translation from Probl. Mat. Anal. 87, 69-78 (2016).
Summary: We discuss variational approaches towards the denoising of images and towards the image inpainting problem combined with simultaneous denoising. Our techniques are based on variants of the TV-model, but in contrast to this case a complete analytical theory is available in our setting. At the same time, numerical experiments illustrate the advantages of our models in comparison with some established techniques.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
49J10 Existence theories for free problems in two or more independent variables
68U10 Computing methodologies for image processing
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] R. Acar and C. R., Vogel, “Analysis of bounded variation penalty methods for ill-posed problems,” Inverse Probl.10, No. 6, 1217-1229 (1994). · Zbl 0809.35151
[2] G. Aubert and L. Vese, “A variational method in image recovery,” SIAM J. Numer. Anal.34, No. 5, 1948-1979 (1997). · Zbl 0890.35033 · doi:10.1137/S003614299529230X
[3] P. Blomgren, T. F. Chan, P. Mulet, L. Vese, and W. L. Wan, “Variational PDE models and methods for image processing,” In: Numerical Analysis 1999, pp. 43-67, Chapman and Hall/CRC, Boca Raton, FL (2000). · Zbl 0953.68621
[4] V. Caselles, A. Chambolle, and M. Novaga, “Regularity for solutions of the total variation denoising problem,” Rev. Mat. Iberoam.27, No. 1, 233-252 (2011). · Zbl 1228.94005 · doi:10.4171/RMI/634
[5] A. Chambolle and P.-L. Lions, “Image recovery via total variation minimization and related problems,” Numer. Math.76, No. 2, 167-188 (1997). · Zbl 0874.68299 · doi:10.1007/s002110050258
[6] T. F. Chan and S. Esedoglu, “Aspects of total variation regularized <Emphasis Type=”Italic“>L1 function approximation,” SIAM J. Appl. Math.65, No. 5, 1817-1837 (2005). · Zbl 1096.94004 · doi:10.1137/040604297
[7] T. Chan, J. Shen, and L. Vese, “Variational PDE models in image processing,” Notices Am. Math. Soc.50, No. 1, 14-26 (2003). · Zbl 1168.94315
[8] Y. Chen, S. Levine, and M. Rao, “Variable exponent, linear growth functionals in image restoration,” SIAM J. Appl. Math.66, No. 4, 1383-1406 (2006). · Zbl 1102.49010 · doi:10.1137/050624522
[9] B. Kawohl, “Variational versus PDE-based approaches in mathematical image processing,” CRM Proc. Lect. Notes44, 113-126 (2008). · Zbl 1144.35401
[10] L. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D60, 259-268 (1992). · Zbl 0780.49028 · doi:10.1016/0167-2789(92)90242-F
[11] L. Vese, “A study in the BV space of a denoising-deblurring variational problem,” Appl. Math. Optimization44, No. 2, 131-161 (2001). · Zbl 1003.35009 · doi:10.1007/s00245-001-0017-7
[12] M. Bildhauer and M. Fuchs, “A variational approach to the denoising of images based on different variants of the TV-regularization,” Appl. Math. Optim.66, No. 3, 331-361 (2012). · Zbl 1260.49074 · doi:10.1007/s00245-012-9174-0
[13] P. Arias, V. Caselles, G. Facciolo, V. Lazcano, and R. Sadek, “Nonlocal variational models for inpainting and interpolation,” Math. Models Methods Appl. Sci.22, Suppl.2, 1230003 (2012). · Zbl 1267.68278
[14] P. Arias, V. Caselles, and G. Sapiro, “A variational framework for non-local image inpainting,” In: Energy Minimization Methods in Computer Vision and Pattern Recognition, pp. 345-358, Springer, Berlin (2009). · Zbl 0581.46036
[15] P. Arias, G. Facciolo, V. Caselles, and G. Sapiro, “A variational framework for exemplarbased image inpainting,” Int. J. Comput. Vis.93, No. 3, 319-347 (2011). · Zbl 1235.94015 · doi:10.1007/s11263-010-0418-7
[16] G. Aubert and P. Kornprobst, Mathematical Problems in Image Processing, Springer, New York (2002). · Zbl 1109.35002
[17] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, “Image inpainting,” In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 417-424,
[18] M. Burger, L. He, and C.-B. Schӧnlieb, “Cahn-Hilliard inpainting and a generalization for grayvalue images,” SIAM J. Imaging Sci.2, No. 4, 1129-1167 (2009). · Zbl 1180.49007 · doi:10.1137/080728548
[19] T. F. Chan, S. H. Kang, and J. Shen, “Euler’s elastica and curvature based inpaintings,” SIAM J. Appl. Math.63, No. 2, 564-592 (2002). · Zbl 1028.68185
[20] T. F. Chan and J. Shen, “Nontexture inpainting by curvature-driven diffusions,” J. Visual Commun. Image Represen.12, No. 4, 436-449 (2001). · doi:10.1006/jvci.2001.0487
[21] T. F. Chan and J. Shen, “Mathematical models for local nontexture inpaintings,” SIAM J. Appl. Math.62, No. 3, 1019-1043 (2001). · Zbl 1050.68157
[22] S. Esedoglu and J. Shen, “Digital inpainting based on the Mumford-Shah-Euler image model,” European J. Appl. Math.13, No. 4, 353-370 (2002). · Zbl 1017.94505 · doi:10.1017/S0956792502004904
[23] K. Papafitsoros, B. Sengul, and C.-B. Schӧnlieb, Combined First and Second Order Total Variation Impainting Using Split Bregman, IPOL Preprint (2012).
[24] J. Shen, “Inpainting and the fundamental problem of image processing,” SIAM News36, No. 5, 1-4 (2003).
[25] M. Bildhauer and M. Fuchs, “Image inpainting with energies of linear growth. A collection of proposals,” J. Math. Sci., New York196, No. 4, 490-497 (2014). · Zbl 1302.49004
[26] M. Bildhauer and M. Fuchs, “On some perturbations of the total variation image inpainting method. Part I: Regularity theory,” J. Math. Sci., New York202, No. 2, 154-169 (2014). · Zbl 1321.49060
[27] M. Bildhauer and M. Fuchs, “On some perturbations of the total variation image inpainting method. Part II: Relaxation and dual variational formulation,” J. Math. Sci., New York202, No. 2, 121-140 (2015). · Zbl 1321.49054
[28] M. Bildhauer and M. Fuchs, “On some perturbations of the total variation image inpainting method. Part III: Minimization among sets with finite perimeter,” J. Math. Sci., New York207, No. 2, 142-146 (2015). · Zbl 1335.49024
[29] M. Bildhauer, M. Fuchs, and C. Tietz, “<Emphasis Type=”Italic“>C1<Emphasis Type=”Italic“>,α-interior regularity for minimizers of a class of variational problems with linear growth related to image inpainting,” St. Petersb. Math. J.27, No. 3, 381-392 (2016). · Zbl 1335.49058
[30] R. A. Adams, Sobolev Spaces, Academic Press, New York (1975), · Zbl 0314.46030
[31] E. Giusti Minimal Surfaces and Functions of Bounded Variation, Birkhӓuser, Basel etc. (1984). · Zbl 0545.49018
[32] F. Demengel and R. Temam, “Convex functions of a measure and applications,” Ind. Univ. Math. J.33, 673-709 (1984). · Zbl 0581.46036 · doi:10.1512/iumj.1984.33.33036
[33] O. A. Ladyzhenskaya and N. N. Ural’tseva, Linear and Quasilinear Elliptic Equations [in Russian], Nauka, Moscow (1964); English transl.: Academic Press, New York (1968). · Zbl 1235.94015
[34] M. Fuchs and C. Tietz, “Existence of generalized minimizers and of dual solutions for a class of variational problems with linear growth related to image recovery,” J. Math. Sci., New York210, No. 4, 458-475 (2015). · Zbl 1331.49014
[35] L. Ambrosio, N. Fusco, and D. Pallara, Functions of Bounded Variation and Free Discontinuity Problems, Clarendon Press, Oxford (2000). · Zbl 0957.49001
[36] G. Anzellotti and M. Giaquinta, “Convex functionals and partial regularity,” Arch. Rat. Mech. Anal.102, 243-272 (1988). · Zbl 0658.49005 · doi:10.1007/BF00281349
[37] Yu. G. Reshetnyak, “Weak convergence of completely additive vector functions on a set” [in Russian], Sib. Mat. Zh.9, No. 6, 1386-1394 (1968); English transl.: Sib. Math. J.9, No. 6, 1039-1045 (1968). · Zbl 0176.44402
[38] D. Spector, “Simple proofs of some results of Reshetnyak,” Proc. Am. Math. Soc.139, No. 5, 1681-1690 (2011). · Zbl 1215.49025 · doi:10.1090/S0002-9939-2010-10593-2
[39] L. Beck and T. Schmidt, “On the Dirichlet problem for variational integrals in BV,” J. Reine Angew. Math.674, 113-194 (2013). · Zbl 1260.49079
[40] R. J. LeVeque, Finite Difference Methods for Ordinary and Partial Differential Equations, SIAM, Philadelphia, PA (2007). · Zbl 1127.65080 · doi:10.1137/1.9780898717839
[41] K. W. Morton and L. M. Mayers, Numerical Solution of Partial Differential Equations. An Introduction, Cambridge University Press, Cambridge (1994). · Zbl 0811.65063
[42] S. Fučik, A. Kratochvil, and J. Nečas, “Kačanov-Galerkin method,” Commentat. Math. Univ. Carol.14, 651-659 (1973). · Zbl 0268.49035
[43] J. Weickert, J. Heers, C. Schnӧrr, K. J. Zuiderveld, O. Scherzer, and H. S. Stiehl, “Fast parallel algorithms for a broad class of nonlinear variational diffusion approaches,” Real-Time Imaging7, No. 1, 31-45 (2001). · Zbl 1010.68934
[44] D. Geman and C. Yang, “Nonlinear image recovery with half-quadratic regularization,” IEEE Trans. Image Process. 4, 932-945 (1995). · doi:10.1109/83.392335
[45] E. Zeidler, Nonlinear Functional Analysis and its Applications II/A: Linear Monotone Operators, Springer, New York etc. (1990). · Zbl 0684.47028 · doi:10.1007/978-1-4612-0985-0
[46] S. Gerschgorin, Fehlerabschӓtzung für das Differenzenverfahren zur Lӧsung Partieller Differentialgleichungen. Z. Angew. Math.10, 373-382 (1930). · JFM 56.0467.03 · doi:10.1002/zamm.19300100409
[47] E. T. Whittaker, “A new method of graduation,” Proc. Edinburgh Math. Soc.41, 65-75 (1923).
[48] A. N. Tikhonov, “Solution of incorrectly formulated problems and the regularization method” [in Russian], Dokl. Akad. Nauk SSSR, 151, 501-504 (1963); English transl.: Sov. Math., Dokl.5, 1035-1038 (1963). · Zbl 0141.11001
[49] M. Bertero, T. A. Poggio, and V. Torre, “Ill-posed problems in early vision,” Proc. IEEE76, 869-889 (1988). · doi:10.1109/5.5962
[50] A. Beck and M. Teboulle, “Fast iterative shrinkage-thresholding algorithm for linear inverse problems,” SIAM J. Imaging Sci.2, No. 1, 183-202 (2009). · Zbl 1175.94009 · doi:10.1137/080716542
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.