Citation: | Liu Lei, Cao Min, Zhang Xiao. Application of improved firefly optimization algorithm in motion shadow removal[J]. Opto-Electronic Engineering, 2019, 46(4): 180120. doi: 10.12086/oee.2019.180120 |
[1] | Zheng L X, Ruan X Y, Chen Y B, et al. Shadow removal for pedestrian detection and tracking in indoor environments[J]. Multimedia Tools and Applications, 2017, 76(18): 18321-18337. doi: 10.1007/s11042-016-3880-6 |
[2] | Yang W D, Guo W, Peng K, et al. Research on removing shadow in workpiece image based on homomorphic filtering[J]. Procedia Engineering, 2012, 29: 2360-2364. doi: 10.1016/j.proeng.2012.01.315 |
[3] | Vicente T F Y, Hoai M, Samaras D. Leave-one-out kernel optimization for shadow detection and removal[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(3): 682-695. doi: 10.1109/TPAMI.2017.2691703 |
[4] | Zhou Y H, Sun L, Zhang J B. A shadow elimination method based on color and texture[C]//Proceedings of 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems, Xiamen, China, 2010: 8-11. |
[5] | Jia Y, Yu X, Dai J, et al. A novel moving cast shadow detection of vehicles in traffic scene[M]//Yang J, Fang F, Sun C Y. Intelligent Science and Intelligent Data Engineering. Berlin, Heidelberg: Springer, 2013: 115-124. |
[6] | Leone A, Distante C. Shadow detection for moving objects based on texture analysis[J]. Pattern Recognition, 2007, 40(4): 1222-1233. doi: 10.1016/j.patcog.2006.09.017 |
[7] | 曹健, 陈红倩, 张凯, 等.结合区域颜色和纹理的运动阴影检测方法[J].机器人, 2011, 33(5): 628-633. doi: 10.3724/SP.J.1218.2011.00628 Cao J, Chen H Q, Zhang K, et al. Moving cast shadow detec -tion based on region color and texture[J]. Robot, 2011, 33(5): 628-633. doi: 10.3724/SP.J.1218.2011.00628 |
[8] | Al-Najdawi N. Cast shadow modelling and detection[J]. Loughborough University, 2006. Ai-Najdawi N, Bez H E, Edirisinghe E A. A Novel Approach For Cast Shadow Modelling and Detection[C]//Iet International Conference on Visual Information Engineering. IET, 2007: 553-558. |
[9] | Sanin A, Sanderson C, Lovell B C. Improved shadow removal for robust person tracking in surveillance scenarios[C]//Proceedings of the 20th International Conference on Pattern Recognition, Istanbul, Turkey, 2010: 141-144. |
[10] | 胡小兵, 黄席樾.基于蚁群优化算法的0-1背包问题求解[J].系统工程学报, 2005, 20(5): 520-523. Hu X B, Huang X Y. Solving 0-1 knapsack problem based on ant colony optimization algorithm[J]. Journal of Systems Engineering, 2005, 20(5): 520-523. |
[11] | 朱立军, 苑玮琦.一种改进蚁群算法的睫毛提取[J].光电工程, 2016, 43(6): 44-50. doi: 10.3969/j.issn.1003-501X.2016.06.008 Zhu L J, Yuan W Q. An eyelash extraction method based on improved ant colony algorithm[J]. Opto-Electronic Engineering, 2016, 43(6): 44-50. doi: 10.3969/j.issn.1003-501X.2016.06.008 |
[12] | 刘桂红, 赵亮, 孙劲光, 等.一种改进粒子群优化算法的Otsu图像阈值分割方法[J].计算机科学, 2016, 43(3): 309-312. doi: 10.3969/j.issn.1007-0249.2003.05.020 Liu G H, Zhao L, Sun J G, et al. An Otsu image threshold segmentation method based on improved particle swarm optimization[J]. Computer Science, 2016, 43(3): 309-312. doi: 10.3969/j.issn.1007-0249.2003.05.020 |
[13] | Li G S, Chou W S. Path planning for mobile robot using self-adaptive learning particle swarm optimization[J]. Science China Information Sciences, 2018, 61(5): 052204. doi: 10.1007/s11432-016-9115-2 |
[14] | Liu Z G, Ji X H, Liu Y X. Hybrid non-parametric particle swarm optimization and its stability analysis[J]. Expert Systems with Applications, 2017, 92: 256-275. doi: 10.1016/j.asoc.2014.12.015 |
[15] | 许川佩, 蔡震, 胡聪.基于蚁群算法的数字微流控生物芯片在线测试路径优化[J].仪器仪表学报, 2014, 35(6): 1417-1424. Xu C P, Cai Z, Hu C. On-line test path optimization for digital microfluidic biochips based on ant colony algorithm[J]. Chinese Journal of Scientific Instrument, 2014, 35(6): 1417-1424. |
[16] | Zhou C H, Tian L W, Zhao H W, et al. A method of two-dimensional Otsu image threshold segmentation based on improved firefly algorithm[C]//Proceedings of 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems, Shenyang, China, 2015: 1420-1424. |
[17] | Huang L, Fang Y M, Zuo X Q, et al. Automatic change detection method of multitemporal remote sensing images based on 2D-otsu algorithm improved by firefly algorithm[J]. Journal of Sensors, 2015, 2015: 327123. |
[18] | Lieu Q X, Do D T T, Lee J. An adaptive hybrid evolutionary firefly algorithm for shape and size optimization of truss structures with frequency constraints[J]. Computers & Structures, 2018, 195: 99-112. |
[19] | 刘金, 金炜东.噪声图像的快速二维Otsu阈值分割[J].计算机应用研究, 2013, 30(10): 3169-3171, 3200. doi: 10.3969/j.issn.1001-3695.2013.10.072 Liu J, Jin W D. Fast thresholding algorithm of 2D Otsu for low SNR image[J]. Application Research of Computers, 2013, 30(10): 3169-3171, 3200. doi: 10.3969/j.issn.1001-3695.2013.10.072 |
[20] | Ojala T, Pietikainen M, Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7): 971-987. doi: 10.1109/TPAMI.2002.1017623 |
Overview: Moving shadow removal is an important research field in computer vision. The purpose is to eliminate the influence of moving shadow on the foreground of moving objects, so as to extract the foreground of moving objects accurately. The moving shadow has similar motion characteristics with the object, often is detected as part of the foreground of the moving target. The geometric characteristics such as the shape and the center of mass of moving objects will appear errors due to the existence of shadows, which will affect the measurement, location, tracking and segmentation of moving objects. It increases the difficulty of moving object detection, and has a bad effect on subsequent recognition and tracking. Currently, shadow removal methods are mainly based on color and texture. The method based on color information uses the invariance of shadows to remove the shadows in the target detection results. However, one disadvantage of this method is that they can only detect small shadows in a frame, and are insensitive to the recognition and shadow detection of dark-tone targets. Texture-based methods use the texture similarity features of shadows to remove the shadow areas, but there are some defects in dealing with flat areas and similar foreground and background textures. Although there are many shadow removal algorithms, the existing algorithms are only applicable to a specific target or a specific application scenario, and the output of the algorithm needs to be improved. To solve this problem, a moving shadow removal algorithm based on improved glowworm optimization algorithm is proposed. That is, the optimal threshold is obtained by optimizing the 2-Otsu distance measure function based on the improved glowworm algorithm which is based on the influence of the best position in the population history, and then the image is segmented and the moving shadow is removed. The results are compared with the traditional 2-Otsu method, particle swarm optimization 2-Otsu method and firefly optimization 2-Otsu method. Experimental results show that this method is 2.69 times, 1.42 times, and 1.21 times faster than the other three methods. The improved algorithm not only has fewer parameters, simpler operation, better stability and global optimization effect, but also has faster convergence speed. The improved firefly algorithm solves the problems of the 2-Otsu method, such as large amount of calculation, high computational complexity and poor real-time performance. Compared with the other three shadow removal algorithms, the algorithm in this paper has been effectively improved in terms of time, region consistency, shadow detection efficiency, detection accuracy and target integrity. Experiments show that the algorithm improves shadow removal efficiency and algorithm speed.
Threshold segmentation graph of traditional Otsu
IFA algorithm schematic diagram
Flow chart of shadow removal algorithm based on IFA
The iterative process of FA and IFA
Highway video sequence shadow removal effect diagram. (a) Video frame; (b) Result without shadow removal; (c) Shadow removal result of traditional 2-Otsu; (d) PSO optimized 2-Otsu shadow removal result; (e) FA optimized 2-Otsu shadow removal result; (f) IFA optimized 2-Otsu shadow removal result
Bungalows video sequence shadow removal effect diagram. (a) Video frame; (b) Result without shadow removal; (c) Shadow removal result of traditional 2-Otsu; (d) PSO optimized 2-Otsu shadow removal result; (e) FA optimized 2-Otsu shadow removal result; (f) IFA optimized 2-Otsu shadow removal result
Outdoor video sequence shadow removal effect diagram. (a) Video frame; (b) Result without shadow removal; (c) Shadow removal result of traditional 2-Otsu; (d) PSO optimized 2-Otsu shadow removal result; (e) FA optimized 2-Otsu shadow removal result; (f) IFA optimized 2-Otsu shadow removal result
Indoor video sequence shadow removal effect diagram. (a) Video frame; (b) Result without shadow removal; (c) Shadow removal result of traditional 2-Otsu; (d) PSO optimized 2-Otsu shadow removal result; (e) FA optimized 2-Otsu shadow removal result; (f) IFA optimized 2-Otsu shadow removal result
Comparison of four algorithms for regional consistenc
Contrast of shadow detection in different algorithms
Comparison of shadow recognition rate of different algorithms
Time comparison of different algorithms for calculating segmentation threshold