An efficient deep learning based fog removal model for multimedia applications

In the present era of technology, several applications such as surveillances systems, security and object recognitions mainly depend on the contents of an image. In this context, the hazy/foggy environment and/or other adverse climatic conditions degrade the image contents that severely influences the result of related applications. The effective haze removal from a single image decides the reliability of these systems. The convolutional neural network (CNN) based techniques are widely used among the available image dehazing methods. However, in CNN based image dehazing techniques, the robustness and accuracy of the learning models are based on the improvement of transmission estimation without giving much concern to the atmospheric light. Therefore, in this paper, the accurate and efficient deep CNN based image dehazing model, which take care the minute information elements during the learning of feature map, is proposed. Besides, the proposed model handles the hallo, blocking artifacts, retainment of fine edges, white region handling, and color fidelity problems, which are primarily responsible for image sharpening and structural stability. For the evaluation of proposed method, the extensive experiments on synthetic and real world images are performed using existing and proposed techniques. The qualitative and quantitative analysis of experimental result shows that the proposed model is more efficient over the existing prior-based and learning-based methods.

PDF

___

[1] Zhu Q, Mai J, Shao L. A fast single image haze removal algorithm using color attenuation prior. IEEE Transactions on Image Processing 2015; 24(11) : 3522-3533.
[2] Berman D, Treibitz T, Avidan. Single image dehazing using haze-lines. IEEE Transactions on Pattern Analysis and Machine Intelligence 2020; 42(3): 720-734.
[3] He K, Sun J, Tang X. Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence 2011; 33(12): 2341-2353.
[4] Raikwar SC, Tapaswi s. An improved linear depth model for single image fog removal. Multimedia Tools and Applications 2018; 77(15): 19 719–19 744.
[5] Narasimhan SG, Nayar SK. Vision and the atmosphere. International Journal of Computer Vision 2002; 48(3): 233-254.
[6] Tan RT. Visibility in bad weather from a single image. In: IEEE 2008 Conference on Computer Vision and Pattern Recognition; Anchorage, AK; 2008, pp. 1-8.
[7] Zhou J, Zhou F. Single image dehazing motivated by retinex theory. In: 2013 IMSNA 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation IEEE; Toronto, ON; 2013, pp. 243-247.
[8] Ancuti CO, Ancuti C. Single image dehazing by multi-scale fusion. IEEE Transactions on Image Processing 2013; 22(8): 3271-3282.
[9] Ngo D, Lee GD, Kang B. Improved color attenuation prior for single-image haze removal. Journal of Applied Sciences 2019; 9(19): 1-22.
[10] Vo AT, Tran HS, Le TH. Advertisement image classification using convolutional neural network. In: 2017 KSE 9th International Conference on Knowledge and Systems Engineering; Hue, 2017, pp. 197-202.
[11] Tang K, Yang J, Wang J. Investigating haze-relevant features in a learning framework for image dehazing. In: 2014 Proceedings of the IEEE conference on computer vision and pattern recognition; Columbus, OH, USA; 2014, pp. 2995-3002.
[12] Ren W, Liu S, Zhang H, Pan J, Cao X, et al. Single image dehazing via multi-scale convolutional neural networks. In: European Conference on Computer Vision; Amsterdam, The Netherlands; 2016, pp. 154–169.
[13] Cai B, Xu X, Jia K, Qing C, Tao D. Dehazenet: An end-to-end system for single image haze removal. IEEE Transactions on Image Processing 2016; 25(11): 5187-5198.
[14] Song Y, Li J, Wang X, and Chen X. Single image dehazing using ranking convolutional neural network. IEEE Transactions on Multimedia 2018; 20(6):1548-1560.
[15] Li B, Peng X, Wang Z, Xu J and Feng D. AOD-Net: All-in-one dehazing network. In: IEEE International Conference on Computer Vision (ICCV); Venice, 2017: pp. 4780-4788.
[16] Rashid H, Zafar N, Iqbal MJ,Dawood H, Dawood H. Single image dehazing using cnn. In: 2019 Procedia Computer Science; 147,2019, pp.124-130.
[17] Ren W, Pan J, Zhang H , Cao X, Yang MH. Single image dehazing via multi-scale convolutional neural networks with holistic edges. International Journal of Computer Vision 2020; 128(1): 240-259.
[18] Hanbury A. Constructing cylindrical coordinate colour spaces. Pattern Recognition Letters 2008; 29(4): 494–500.
[19] Huang J, Jiang W, Li L, Wen Y, Zhou G. Deeptransmap: a considerably deep transmission estimation network for single image dehazing. Multimedia Tools and Applications 2019;78(21): 30 627-30 649.
[20] Lampl I, Ferster D, Poggio T, Riesenhuber M. Intracellular measurements of spatial integration and the max operation in complex cells of the cat primary visual cortex. Journal of Neurophysiology 2014 ; 92(5): 2704-2713.
[21] Li J, Li G, Fan H. Image dehazing using residual-based deep cnn. IEEE Access 2018; 6: 26 831–26 842.
[22] Kingma D, Lei Ba J. Adam: a method for stochastic optimization 3rd international Conference learn. Representations (Preprint 1412.6980 v9), 2015.
[23] Raikwar SC, Tapaswi S. Adaptive dehazing control factor based fast single image dehazing. Multimedia Tools and Applications 2020; 79(1-2): 891-918.
[24] Ma K, Liu W, Wang Z. Perceptual evaluation of single image dehazing algorithms.In:2015 ICIP IEEE International Conference on Image Processing; 2015. pp. 3600–3604.
[25] Arad B, Ohad Ben-Shahar, Radu Timofte et al. NTIRE 2018 challenge on spectral reconstruction from RGB Images In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, 2018, pp. 1042-1049.
[26] Li B, Ren W, Fu D, Tao D, Feng D, et al. Benchmarking single-image dehazing and beyond. IEEE Transactions on Image Processing 2019; 28(1): 492-505.
[27] Hautière N, Tarel JP, Aubert D, Dumont E. Blind contrast enhancement assessment by gradient ratioing at visible edges. Image Analysis & Stereology 2008; 27(2): 87-95.
[28] Yu X, Xiao C, Deng M, Peng L. A classification algorithm to distinguish image as haze or non-haze. In: 2011 Sixth International Conference on Image and Graphics; 2011. pp. 286-289.
[29] Tripathi AK, Mukhopadhyay S. Removal of fog from images: A review. IETE Technical Review 2012; 29(2):148-156.
[30] Jobson DJ, Rahman Z, Woodell GA, Hines GD. A comparison of visual statistics for the image enhancement of foresite aerial images with those of major image classes. In: Defence and security Symposium, Orlando, Florida, FL, USA; 2006.
[31] Yu J, Xu DB, Liao QM. Image defogging: a survey. Journal of Image and Graphics 2011; 16(9): 1561-1576.
[32] Wang Z, Bovik AC. A universal image quality index. IEEE Signal Processing Letters 2002; 9(3): 81-84.