In view of the problem about uneven image acquisition and inaccurate edge extraction in pipeline detection process, a pipeline robot defect inspection method based on adaptive image enhancement is proposed. Firstly, a single-scale Retinex adaptive image enhancement algorithm is designed, which uses the guided filter to estimate the illumination component of the Value component of the image, and gets the illumination equilibrium image by adaptive Gamma correction, so as to realize the image enhancement. Then, the traditional Canny edge detection method is improved, using bilateral filtering to smooth the image. Besides, the defect images are segmented by the iterative threshold method, and the edge connection is carried out according to the edge pixel similarity. Therefore, the defect contour of the pipe-wall is extracted effectively. Thirdly, a pipeline robot defect detection system based on adaptive image enhancement is built, and a crawler car equipped with the pan-tilt-zoom camera conducts all-round visual inspection of the defects in the pipeline inner wall. The experimental results show that the detection method in this paper can adaptively correct the image brightness, and the uneven brightness of the image is significantly improved. Compared with the sub-optimal algorithm, the information entropy of the image is increased by 2.4%, the average gradient of the image is increased by 2.3%, and the peak signal to noise ratio is increased by 4.4%, and the pipeline defect edges are extracted effectively with the detection accuracy up to 97%.
Research on defect inspection method of pipeline robot based on adaptive image enhancement
First published at:Jan 14, 2020
 Hong D H, Wang H L, Li W P, et al. Study on the defects in welded joint of hot reheat steam pipe of ultra supercritical units after long-term service[J]. Journal of Mechanical Engineering, 2017, 53(18): 113–120.
洪鼎华, 王环丽, 李武平, 等. 在役P92钢蒸汽管道焊接接头中缺陷的研究[J]. 机械工程学报, 2017, 53(18): 113–120.
 Yang X F, Wu Y Y, Zhao L. Pipeline crack detection algorithm based on Canny detector[J]. Computer Engineering and Design, 2018, 39(3): 798–803.
杨先凤, 吴媛媛, 赵玲. 基于Canny改进算子的油管裂纹检测算法[J]. 计算机工程与设计, 2018, 39(3): 798–803.
 Sun L, Sun Q Q, Ren L, et al. A new method for underground pipeline corrosion monitoring applied FBG[J]. Acta Photonica Sinica, 2012, 41(1): 6–10.
孙丽, 孙茜茜, 任亮, 等. 应用光纤布喇格光栅传感器监测地下管道腐蚀的新方法研究[J]. 光子学报, 2012, 41(1): 6–10.
 Cao J S, Cao Z, Zhao L F, et al. Detecting techniques of surface crack of pipeline based on laser ultrasonic[J]. Opto-Electronic Engineering, 2016, 43(3): 1–6.
曹建树, 曹振, 赵龙飞, 等. 激光超声管道表面裂纹检测技术[J]. 光电工程, 2016, 43(3): 1–6.
 Zhang P, Chen Z D, Li X X, et al. X-ray digital image of weld defect based on wavelet transform edge detection[J]. Pipeline Technique and Equipment, 2016(3): 41–43.
张盼, 陈志东, 李晓旭, 等. 基于小波变换的X射线数字图像焊缝缺陷边缘检测[J]. 管道技术与设备, 2016(3): 41–43.
 Wang Z G, Luo Q W, Shi Y B, et al. Analysis of eddy current coil coupling in ferromagnetic pipe and pipe’s parameter detec-tion[J]. Chinese Journal of Scientific Instrument, 2014, 35(12): 2843–2851.
王志刚, 罗清旺, 师奕兵, 等. 铁磁性管道内涡流线圈耦合分析与管道参数检测[J]. 仪器仪表学报, 2014, 35(12): 2843–2851.
 Yang J X, Li C, Xia S, et al. Magnetostrictive guided wave flaw detection system for pipeline[J]. Instrument Technique and Sensor, 2017(6): 95–97, 167.
杨金旭, 李策, 夏胜, 等. 基于磁致伸缩导波的管道缺陷检测系统[J]. 仪表技术与传感器, 2017(6): 95–97, 167.
 Su T C, Yang M D. Application of morphological segmentation to leaking defect detection in sewer pipelines[J]. Sensors, 2014, 14(5): 8686–8704.
 Vriesman D, Britto A S, Zimmer A, et al. Automatic visual in-spection of thermoelectric metal pipes[J]. Signal, Image and Video Processing, 2019, 13(5): 975–983.
 Yang Z Y, Lu S H, Wu T, et al. Detection of morphology defects in pipeline based on 3D active stereo omnidirectional vision sensor[J]. IET Image Processing, 2018, 12(4): 588–595.
 Wang Y, Zhang R. In-pipe surface circular structured light 3D vision inspection system[J]. Infrared and Laser Engineering, 2014, 43(3): 891–896.
王颖, 张瑞. 管道内表面圆结构光视觉三维测量系统[J]. 红外与激光工程, 2014, 43(3): 891–896.
 Wu B, Shao Z Y, Zhang Y H. A new technology of building up defect measuring system for inner micro-pipe[J]. Journal of Optoelectronics?Laser, 2014, 25(2): 293–298.
吴斌, 邵震宇, 张云昊. 微细管道内壁缺陷测量系统构建和技术[J]. 光电子?激光, 2014, 25(2): 293–298.
 Haertel M E M, da Costa Pinto T L F, Júnior A A G. Trinocular stereo system with object space oriented correlation for inner pipe inspection[J]. Measurement, 2015, 73: 162–170.
 Land E H, McCann J J. Lightness and retinex theory[J]. Journal of the Optical Society of America, 1971, 61(1): 1–11.
 Bradley D, Roth G. Adaptive thresholding using the integral image[J]. Journal of Graphics Tools, 2007, 12(2): 13–21.
 Wei W Y, Ren X K. Quadtree image retrieval based on image entropy[J]. Journal of Jiamusi University (Natural Science Edi-tion), 2005, 23(4): 511–514, 521.
魏伟一, 任小康. 基于图像信息熵的四叉树检索算法[J]. 佳木斯大学学报(自然科学版), 2005, 23(4): 511–514, 521.
 Ren H E, Liu M, Dong B Z. Edge detection algorithm of wood-flour based on modified morphological operator[J]. Computer Engineering and Applications, 2015, 51(5): 183–186.
任洪娥, 刘冕, 董本志. 基于改进形态学算子的木粉边缘检测算法[J]. 计算机工程与应用, 2015, 51(5): 183–186.
 Hao L H, Wang M Q. Application of improved canny algorithm in defect edge detection of straight weld image[J]. Fire Control & Command Control, 2017, 42(7): 52–55.
郝利华, 王明泉. 改进的Canny算法在直焊缝图像缺陷边缘检测中的应用[J]. 火力与指挥控制, 2017, 42(7): 52–55.
 Lin H, Zhao C S, Shu N. Edge detection based on Canny operator and evaluation[J]. Journal of Heilongjiang Institute of Technology, 2003, 17(2): 3–6, 16.
林卉, 赵长胜, 舒宁. 基于Canny算子的边缘检测及评价[J]. 黑龙江工程学院学报, 2003, 17(2): 3–6, 16.
 Chen H X. Study on the objective evaluation of the perfor-mance of edge detection operator based on the quality factor[J]. Automation & Instrumentation, 2015(8): 8–10.
陈宏希. 基于品质因数的边缘检测算子性能优劣客观评价研究[J]. 自动化与仪器仪表, 2015(8): 8–10.
National Natural Science Foundation of China (51805280) and Natural Science Foundation of Zhejiang Province (LQ18E050005)
Get Citation: Li Ping, Liang Dan, Liang Dongtai, et al. Research on defect inspection method of pipeline robot based on adaptive image enhancement[J]. Opto-Electronic Engineering, 2020, 47(1): 190304.