Image captured in foggy weather often exhibits low contrast and poor image quality, which may have a negative impact on computer vision applications. Aiming at these problems, we propose an image dehazing algorithm by combining light field technology with atmospheric scattering model. Firstly, taking the advantages of capturing multi-view information from light field camera is used to extracting defocus cues and correspondence cues, which are used to estimating the depth information of hazy images, and use the obtained depth information to calculating the scene’s initial transmission. Then use scene depth information to build a new weight function, and combined it with 1-norm context regularization to optimizing the initial transmission map iteratively. Finally, the central perspective image of hazy light field images is dehazed using atmospheric scattering model to obtain the final dehazed images. Experimental results on synthetic hazy images and real hazy images demonstrate that, compared to existing single image dehazing algorithms, the peak signal to noise ratio get 2 dB improvement and the structural similarity raise about 0.04. Moreover, our approach preserves more fine structural information of images and has faithful color fidelity, thus yielding a superior image dehazing result.
Image dehazing algorithm by combining light field multi-cues and atmospheric scattering model
First published at:Sep 17, 2020
 Shao L, Liu L, Li X L. Feature learning for image classification via multiobjective genetic programming[J]. IEEE Transactions on Neural Networks and Learning Systems, 2014, 25(7): 1359–1371.
 Crebolder J M, Sloan R B. Determining the effects of eyewear fogging on visual task performance[J]. Applied Ergonomics, 2004, 35(4): 371–381.
 Xiao C B, Zhao H Y, Yu J, et al. Traffic image defogging method based on WLS[J]. Infrared and Laser Engineering, 2015, 44(3): 1080–1084.
肖创柏, 赵宏宇, 禹晶, 等. 基于WLS的雾天交通图像恢复方法[J]. 红外与激光工程, 2015, 44(3): 1080–1084.
 Zhu F, Shao L. Weakly-supervised cross-domain dictionary learning for visual recognition[J]. International Journal of Computer Vision, 2014, 109(1–2): 42–59.
 Zhang Z, Tao D C. Slow feature analysis for human action recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(3): 436–450.
 Wang L J, Zhu R. Image defogging algorithm of single color image based on wavelet transform and histogram equalization[J]. Applied Mathematical Sciences, 2013, 7(79): 3913–3921.
 Shen H F, Li H F, Qian Y, et al. An effective thin cloud removal procedure for visible remote sensing images[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2014, 96: 224–235.
 Pei S C, Lee T Y. Nighttime haze removal using color transfer pre-processing and Dark Channel Prior[C]//Proceedings of the 2012 19th IEEE International Conference on Image Processing, Orlando, FL, USA, 2012.
 Zhu Q S, Yang S, Heng P A, et al. An adaptive and effective single image dehazing algorithm based on dark channel prior[C]//Proceedings of 2013 IEEE International Conference on Robotics and Biomimetics, Shenzhen, China, 2013.
 Oakley J P, Satherley B L. Improving image quality in poor visibility conditions using a physical model for contrast degradation[J]. IEEE Transactions on Image Processing, 1988, 7(2): 167–169.
 Berman D, Treibitz T, Avidan S. Non-local image dehazing[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016: 1674–1682.
 Meng G F, Wang Y, Duan J Y, et al. Efficient image dehazing with boundary constraint and contextual regularization[C]//Proceedings of 2013 IEEE International Conference on Computer Vision, Sydney, NSW, Australia, 2013.
 Zhu Q S, Mai J M, Shao L. A fast single image haze removal algorithm using color attenuation prior[J]. IEEE Transactions on Image Processing, 2015, 24(11): 3522–3533.
 He K M, Sun J, Tang X O. Single image haze removal using dark channel prior[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(12): 2341–2353.
 Tarel J P, Hautière N. Fast visibility restoration from a single color or gray level image[C]//Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan, 2009.
 Cai B L, Xu X M, Jia K, et al. DehazeNet: an end-to-end system for single image haze removal[J]. IEEE Transactions on Image Processing, 2016, 25(11): 5187–5198.
 Zhu Y Y, Tang G Y, Zhang X Y, et al. Haze removal method for natural restoration of images with sky[J]. Neurocomputing, 2018, 275: 499–510.
 Schechner Y Y, Narasimhan S G, Nayar S K. Polarization-based vision through haze[J]. Applied Optics, 2003, 42(3): 511–525.
 Raikwar S C, Tapaswi S. An improved linear depth model for single image fog removal[J]. Multimedia Tools and Applications, 2018, 77(15): 19719–19744.
 Ng R, Levoy M, Brédif M, et al. Light field photography with a hand-held plenoptic camera[J]. Computer Science Technical Report CSTR, 2005, 2(11): 1–11.
 Tao M W, Srinivasan P P, Malik J, et al. Depth from shading, defocus, and correspondence using light-field angular coherence[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 2015.
 Raj A S, Lowney M, Shah R. Light-field database creation and depth estimation[R]. Palo Alto, USA: Stanford University, 2016.
 Wang T C, Efros A A, Ramamoorthi R. Occlusion-aware depth estimation using light-field cameras[C]//Proceedings of 2015 IEEE International Conference on Computer Vision, Santiago, Chile, 2015.
 Williem W, Park I K. Robust light field depth estimation for noisy scene with occlusion[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016: 4396–4404.
 Wang M, Zhou S D, Huang F, et al. The study of color image defogging based on wavelet transform and single scale retinex[J]. Proceedings of SPIE, 2011, 8194: 81940F.
 Ramya C, Rani D S. Contrast enhancement for fog degraded video sequences using BPDFHE[J]. International Journal of Computer Science and Information Technologies, 2012, 3(2): 3463–3468.
 Xu Z Y, Liu X M, Chen X N. Fog removal from video sequences using contrast limited adaptive histogram equalization[C]//Proceedings of 2009 International Computational Intelligence and Software Engineering, Wuhan, China, 2009.
 Howard J N. Book Reviews: Scattering Phenomena[J]. Science, 1977, 196(4294): 1084–1085.
 Narasimhan S G, Nayar S K. Contrast restoration of weather degraded images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(6): 713–724.
 Narasimhan S G, Nayar S K. Vision and the atmosphere[J]. International Journal of Computer Vision, 2002, 48(3): 233–254.
 Xiong W, Zhang J, Gao X J, et al. Anti-occlusion light-field depth estimation from adaptive cost volume[J]. Journal of Image and Graphics, 2018, 22(12): 1709–1722.
熊伟, 张骏, 高欣健, 等. 自适应成本量的抗遮挡光场深度估计算法[J]. 中国图象图形学报, 2018, 22(12): 1709–1722.
 Sun J, Shum H Y, Zheng N N. Stereo matching using belief propagation[C]//Proceedings of the 7th European Conference on Computer Vision, Denmark, 2002: 510–524.
 Hu X Y, Mordohai P. A quantitative evaluation of confidence measures for stereo vision[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11): 2121–2133.
 Tan R T. Visibility in bad weather from a single image[C]//Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, 2008.
 Tang K, Yang J C, Wang J. Investigating haze-relevant features in a learning framework for image dehazing[C]//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 2014.
 Ying Z Q, Li G, Gao W. A bio-inspired multi-exposure fusion framework for low-light image enhancement[Z]. arXiv:1711.00591[cs], 2017.
National Natural Science Foundation of China (61876057,61571175)
Get Citation: Wang Xin, Zhang Xudong, Zhang Jun, et al. Image dehazing algorithm by combining light field multi-cues and atmospheric scattering model[J]. Opto-Electronic Engineering, 2020, 47(9): 190634.