# zbMATH — the first resource for mathematics

A single image dehazing model using total variation and inter-channel correlation. (English) Zbl 1448.94020
Summary: Outdoor images are often degraded by haze, causing a change of image contrast and color values. In this paper, we propose a novel variational model for the removal of haze in a single color image, by incorporating an inter-channel correlation term into the total variation based model in [W. Wang et al., “A constrained total variation model for single image dehazing”, Pattern Recognition 80, 196–209 (2018; doi:10.1016/j.patcog.2018.03.009)]. The proposed model enables both color and gray-valued transmission maps, contributing to its broad applications, and its convergence analysis is also provided. To realize the proposed model, we adopt an alternating minimization algorithm, and then the alternating direction method of multipliers is employed for solving subproblems. These result in an efficient iterative algorithm, with its convergence proven. Numerical experiments validate the outstanding performance of the proposed model compared to the state-of-the-art methods.

##### MSC:
 94A08 Image processing (compression, reconstruction, etc.) in information and communication theory 49J10 Existence theories for free problems in two or more independent variables 49N45 Inverse problems in optimal control 90C25 Convex programming
Full Text:
##### References:
 [1] Ancuti, C., Ancuti, C.O., & De Vleeschouwer, C. (2016). D-hazy: A dataset to evaluate quantitatively dehazing algorithms. In: Procedings of the IEEE conference on image processing, pp. 2226-2230. [2] Baig, N.; Riaz, M.; Ghafoor, A.; Siddiqui, A., Image dehazing using quadtree decomposition and entropy-based contextual regularization, IEEE Signal Processing Letters, 23, 6, 853-857 (2016) [3] Beck, A.; Teboulle, M., Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems, IEEE Transactions on Image Processing, 18, 11, 2419-2434 (2009) · Zbl 1371.94049 [4] Bertalmío, M.; Caselles, V.; Provenzi, E.; Rizzi, A., Perceptual color correction through variational techniques, IEEE Transactions on Image Processing, 16, 4, 1058-1072 (2007) [5] Bochnak, J.; Coste, M.; Roy, M., Real algebraic geometry (2013), Berlin: Springer Science & Business Media, Berlin · Zbl 0633.14016 [6] Bolte, J.; Daniilidis, A.; Lewis, A., The łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems, SIAM Journal on Optimization, 17, 4, 1205-1223 (2007) · Zbl 1129.26012 [7] Boyd, S.; Parikh, N.; Chu, E.; Peleato, B.; Eckstein, J., Distributed optimization and statistical learning via the alternating direction method of multipliers, Foundations and Trends® in Machine learning, 3, 1, 1-122 (2011) · Zbl 1229.90122 [8] Bresson, X.; Chan, T., Fast dual minimization of the vectorial total variation norm and applications to color image processing, Inverse Problems and Imaging, 2, 4, 455-484 (2008) · Zbl 1188.68337 [9] Caraffa, L., & Tarel, J.P. (2013). Markov random field model for single image defogging. In IEEE intelligent vehicles symposium, pp. 994-999. [10] Chacon-Murguia, M.; Gonzalez-Duarte, S., An adaptive neuralfuzzy approach for object detection in dynamic backgrounds for surveillance systems, IEEE Transactions on Industrial Electronics, 59, 8, 3286-3298 (2012) [11] Chang, K.; Ding, P.; Li, B., Color image demosaicking using inter-channel correlation and nonlocal self-similarity, Signal Processing: Image Communication, 39, 264-279 (2015) [12] Chen, BH; Huang, SC, An advanced visibility restoration algorithm for single hazy images, ACM Transactions on Multimedia Computing, Communications, and Applications, 11, 4, 53 (2015) [13] Choi, L.; You, J.; Bovik, A., Referenceless prediction of perceptual fog density and perceptual image defogging, IEEE Transactions on Image Processing, 24, 11, 3888-3901 (2015) · Zbl 1408.94103 [14] Dai, S. k., & Tarel, J.P. (2015). Adaptive sky detection and preservation in dehazing algorithm. In 2015 IEEE international symposium on intelligent signal processing and communication systems, pp. 634-639. [15] Fang, F.; Li, F.; Zeng, T., Single image dehazing and denoising: A fast variational approach, SIAM Journal on Imaging Sciences, 7, 1, 969-996 (2014) · Zbl 1299.68200 [16] Fattal, R. (2008). Single image dehazing. In SIGGRAPH, pp. 1-9. [17] Fattal, R., Dehazing using color-lines, ACM Transactions on Graphics, 34, 1, 1-14 (2014) [18] Fu, X., Zeng, D., Huang, Y., Zhang, X.P., & Ding, X. (2016). A weighted variational model for simultaneous refectance and illumination estimation. In Proceedings of the IEEE conference Computer Vision and Pattern Recognition, pp. 2782-2790. [19] Galdran, A.; Vazquez-Corral, J.; Pardo, D.; Bertalmio, M., Enhanced variational image dehazing, SIAM Journal on Imaging Sciences, 8, 3, 1519-1546 (2015) · Zbl 1341.94004 [20] Galdran, A.; Vazquez-Corral, J.; Pardo, D.; Bertalmio, M., Fusion-based variational image dehazing, IEEE Signal Processing Letters, 24, 2, 151-155 (2017) [21] Gibson, KB; Vo, DT; Nguyen, TQ, An investigation of dehazing effects on image and video coding, IEEE Transactions on Image Processing, 21, 2, 662-673 (2012) · Zbl 1372.94091 [22] Goldstein, T.; Osher, S., The split bregman method for l1-regularized problems, SIAM Journal on Imaging Sciences, 2, 2, 323-343 (2009) · Zbl 1177.65088 [23] Guo, JM; Syue, JY; Radzicki, V.; Lee, H., An efficient fusion-based defogging, IEEE Transactions on Image Processing, 26, 9, 4217-4228 (2017) · Zbl 1409.94198 [24] He, K.; Sun, J.; Tang, X., Guided image filtering, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 6, 1397-1409 (2013) [25] He, L.; Zhao, J.; Zheng, N.; Bi, D., Haze removal using the difference-structure-preservation prior, IEEE Transactions on Image Processing, 26, 3, 1063-1075 (2017) · Zbl 1409.94222 [26] Huang, SC; Ye, JH; Chen, BH, An advanced single-image visibility restoration algorithm for real-world hazy scenes, IEEE Transactions on Industrial Electronics, 62, 5, 2962-2972 (2015) [27] He, K.; Sun, J.; T, X., Single image haze removal using dark channel prior, IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 12, 2341-2353 (2011) [28] Kimmel, R.; Elad, M.; Shaked, D.; Keshet, R.; Sobel, I., A variational framework for retinex, International Journal of Computer Vision, 52, 1, 7-23 (2003) · Zbl 1009.68642 [29] Kopf, J.; Neubert, B.; Chen, B.; Cohen, M.; Cohen-Or, D.; Deussen, O.; Uyttendaele, M.; Lischinski, D., Deep photo: Model-based photograph enhancement and viewing, ACM Transactions on Graphics, 27, 5, 116 (2008) [30] Lai, YH; Chen, YL; Chiou, CJ; Hsu, CT, Single-image dehazing via optimal transmission map under scene priors, IEEE Transactions on Circuits and Systems for Video Technology, 25, 1, 1-14 (2015) [31] Liu, J.; Wang, X.; Chen, M.; Liu, SG; Zhou, XR; Shao, ZF; Liu, P., Thin cloud removal from single satellite images, Optics Express, 22, 1, 618-632 (2014) [32] Lojasiewicz, S., Une propriété topologique des sous-ensembles analytiques réels, Les équations aux dérivées partielles, 117, 87-89 (1963) [33] Long, J.; Shi, ZW; Tang, W.; Zhang, CS, Single remote sensing image dehazing, IEEE Geoscience and Remote Sensing Letters, 11, 1, 59-63 (2014) [34] Makarau, A.; Richter, R.; Muller, R.; Reinartz, P., Haze detection and removal in remotely sensed multispectral imagery, IEEE Transactions on Geoscience and Remote Sensing, 52, 9, 5895-5905 (2014) [35] Narasimhan, S., & Nayar, S. (2000). Chromatic framework for vision in bad weather. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 598-605. [36] Narasimhan, S.; Nayar, S., Vision and the atmosphere, International Journal of Computer Vision, 48, 3, 233-254 (2002) · Zbl 1012.68760 [37] Narasimhan, S.; Nayar, S., Contrast restoration of weather degraded images, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 6, 713-724 (2003) [38] Narasimhan, S., & Nayar, S. (2003). Interactive deweathering of an image using physical models. In Proceedings of the IEEE workshop color and photometric methods in computer vision, in Conjunction with IEEE int’l conference computer vision. [39] Nayar, S., & Narasimha, S. (1999). Vision in bad weather. In Proceedings of the Seventh IEEE International Conference on Computer Vision, 2, 820-827. [40] Nesterov, Y., A method for solving convex programming problems with convergence speed $$o(1/k^2)$$, Doklady Akademii Nauk, 269, 3, 543-547 (1983) [41] Ng, M.; Wang, W., A total variation model for retinex, SIAM Journal on Imaging Sciences (SIIMS), 4, 1, 345-365 (2011) · Zbl 1215.65117 [42] Ng, MK; Chan, RH; Tang, WC, A fast algorithm for deblurring models with Neumann boundary conditions, SIAM Journal on Scientific Computing, 21, 3, 851-866 (1999) · Zbl 0951.65038 [43] Ortega, JM; Rheinboldt, WC, Iterative solution of nonlinear equations in several variables (1970), New York: Academic Press, New York [44] Pan, XX; Xie, FY; Jiang, ZG; Yin, JH, Haze removal for a single remote sensing image based on deformed haze imaging model, IEEE Signal Processing Letters, 22, 10, 1806-1810 (2015) [45] Piasco, N.; Sidibé, D.; Demonceaux, C.; Gouet-Brunet, V., A survey on visual-based localization: On the benefit of heterogeneous data, Pattern Recognition, 74, 90-109 (2018) [46] Poynton, C. (1998). Frequently asked questions about gamma. Rapport Technique, janvier 152. [47] Rudin, LI; Osher, S.; Fatemi, E., Nonlinear total variation based noise removal algorithms, Journal of Physics D, 60, 1-4, 259-268 (1992) · Zbl 0780.49028 [48] Schechner, Y., Narasimhan, S., & Nayar, S. (2001). Instant dehazing of images using polarization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1, 325-332. [49] Shwartz, S.; Namer, E.; Schechner, Y., Blind haze separation, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2, 1984-1991 (2006) [50] Tan, R. (2008). Visibility in bad weather from a single image. In 2008 IEEE conference on computer vision and pattern recognition. [51] Tarel, JP; Hautiere, N.; Caraffa, L.; Cord, A.; Halmaoui, H.; Gruyer, D., Vision enhancement in homogeneous and heterogeneous fog, IEEE Intelligent Transportation Systems Magazine, 4, 1, 6-20 (2012) [52] Tseng, P., Dual coordinate ascent methods for non-strictly convex minimization, Mathematical Programming, 59, 1-3, 231-247 (1993) · Zbl 0782.90073 [53] Tseng, P., Convergence of a block coordinate descent method for nondifferentiable minimization, Journal of Optimization Theory and Applications, 109, 3, 475-494 (2001) · Zbl 1006.65062 [54] Wang, JB; He, N.; Zhang, LL; Lu, K., Single image dehazing with a physical model and dark channel prior, Neurocomputing, 149, B, 718-728 (2015) [55] Wang, W.; He, C., A variational model with barrier functionals for retinex, SIAM Journal on Imaging Sciences (SIIMS), 8, 3, 1955-1980 (2015) · Zbl 1330.94012 [56] Wang, W.; He, C.; Xia, X., A constrained total variation model for single image dehazing, Pattern Recognition, 80, 196-209 (2018) [57] Wang, W.; Yuan, X.; Wu, X.; Liu, Y., Fast image dehazing method based on linear transformation, IEEE Transactions on Multimedia, 19, 6, 1142-1155 (2017) [58] Wang, YK; Fan, CT, Single image defogging by multiscale depth fusion, IEEE Transactions on Image Processing, 23, 11, 4826-4837 (2014) · Zbl 1374.94403 [59] Wang, Z.; Bovik, AC; Sheikh, HR; Simoncelli, EP, Image quality assessment: From error visibility to structural similarity, IEEE Transactions on Image Processing, 13, 600-612 (2004) [60] Xie, B.; Guo, F.; Cai, ZX, Universal strategy for surveillance video defogging, Optical Engineering, 51, 10, 101703 (2012) [61] Xu, Y.; Yin, W., A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion, SIAM Journal on Imaging Sciences (SIIMS), 6, 3, 1758-1789 (2013) · Zbl 1280.49042 [62] Yoon, I.; Kim, S.; Kim, D.; Hayes, MH; Paik, J., Adaptive defogging with color correction in the hsv color space for consumer surveillance system, IEEE Transactions on Consumer Electronics, 58, 1, 111-116 (2012) [63] Zhu, Q.; Mai, J.; Shao, L., A fast single image haze removal algorithm using color attenuation prior, IEEE Transactions on Image Processing, 24, 11, 3522-3533 (2015) · Zbl 1408.94853 [64] Zhuo, S.; Sim, T., Defocus map estimation from a single image, Pattern Recognition, 44, 9, 1852-1858 (2011)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.