Wei B Y, Tian Q G, Ge B Z. Camera calibration based on color-coded phase-shifted fringe[J]. Opto-Electron Eng, 2021, 48(1): 200118. doi: 10.12086/oee.2021.200118
Citation: Wei B Y, Tian Q G, Ge B Z. Camera calibration based on color-coded phase-shifted fringe[J]. Opto-Electron Eng, 2021, 48(1): 200118. doi: 10.12086/oee.2021.200118

Camera calibration based on color-coded phase-shifted fringe

    Fund Project: National Natural Science Foundation of China (61535008)
More Information
  • Aiming at the low adaptability of blurring noise of target feature points in traditional calibration methods, a calibration method based on the color-coded phase-shifted fringe is proposed. Using a liquid crystal display panel as the calibration target, horizontal and vertical color-coded phase-shifted stripes are displayed in sequence; the orthogonal phase-shifted stripes are obtained by separating color channels; based on the phase-shifteg theory, the intersections of the orthogonal phase truncation lines are calculated as the feature points. After changing the target position multiple times and extracting feature points, the plane-based camera calibration technique is applied to realize the calibration of both the single camera and the binocular system. Furthermore, color-coded phase-shift circles are added to four corners of the target pattern to automatically extract and sort feature points. Accordingly, the efficiency of calibration is promoted. The experimental results indicate that when the target image is blurred, the reprojection error of the single-camera calibration is 0.15 pixels, and the standard deviation of the binocular system measurement after calibration is 0.1 mm.
  • 加载中
  • [1] Li L L, Zhao W C, Wu F, et al. Experimental analysis and improvement on camera calibration pattern[J]. Opt Eng, 2014, 53(1): 013104. doi: 10.1117/1.OE.53.1.013104

    CrossRef Google Scholar

    [2] Mallon J, Whelan P F. Which pattern? Biasing aspects of planar calibration patterns and detection methods[J]. Pattern Recognit Lett, 2007, 28(8): 921–930. doi: 10.1016/j.patrec.2006.12.008

    CrossRef Google Scholar

    [3] Li D, Tian J D. An accurate calibration method for a camera with telecentric lenses[J]. Opt Lasers Eng, 2013, 51(5): 538–541. doi: 10.1016/j.optlaseng.2012.12.008

    CrossRef Google Scholar

    [4] Liu Z, Wu Q, Chen X, et al. High-accuracy calibration of low-cost camera using image disturbance factor[J]. Opt Express, 2016, 24(21): 24321–24336. doi: 10.1364/OE.24.024321

    CrossRef Google Scholar

    [5] Bell T, Xu J, Zhang S. Method for out-of-focus camera calibration[J]. Appl Opt, 2016, 55(9): 2346–2352. doi: 10.1364/AO.55.002346

    CrossRef Google Scholar

    [6] Wang Y W, Chen X C, Tao J Y, et al. Accurate feature detection for out-of-focus camera calibration[J]. Appl Opt, 2016, 55(28): 7964–7971. doi: 10.1364/AO.55.007964

    CrossRef Google Scholar

    [7] 刘元坤, 苏显渝. 基于傅里叶条纹分析的摄像机标定[J]. 四川大学学报(工程科学版), 2007, 39(6): 149–153. doi: 10.3969/j.issn.1009-3087.2007.06.029

    CrossRef Google Scholar

    Liu Y K, Su X Y. A new camera calibration technique using FTP method[J]. J Sichuan Univ (Eng Sci Ed), 2007, 39(6): 149–153. doi: 10.3969/j.issn.1009-3087.2007.06.029

    CrossRef Google Scholar

    [8] 李璐璐, 赵文川, 伍凡, 等. 摄像机标定中的特征点提取算法研究与改进[J]. 光学学报, 2014, 34(5): 0515002.

    Google Scholar

    Li L L, Zhao W C, Wu F, et al. Analysis and improvement of characteristic points extraction algorithms in camera calibration[J]. Acta Opt Sin, 2014, 34(5): 0515002.

    Google Scholar

    [9] Ma M C, Chen X C, Wang K Y. Camera calibration by using fringe patterns and 2D phase-difference pulse detection[J]. Optik, 2014, 125(2): 671–674. doi: 10.1016/j.ijleo.2013.07.055

    CrossRef Google Scholar

    [10] 杨浩, 蔡宁, 林斌, 等. 基于正弦相位编码的相机离焦标定[J]. 光子学报, 2018, 47(7): 0715002.

    Google Scholar

    Yang H, Cai N, Lin B, et al. Defocus camera calibration based on sinusoidal phase coding[J]. Acta Photon Sin, 2018, 47(7): 0715002.

    Google Scholar

    [11] 葛尉. 基于彩色相位编码条纹投影的三维测量方法研究[D]. 南京: 东南大学, 2016: 4–6.

    Google Scholar

    Ge W. Research on 3D measurement based on color phase-encoded fringe projection[D]. Nanjing: Dongnan University, 2016: 4–6.

    Google Scholar

    [12] Pan J H, Huang P S, Chiang F P. Color phase-shifting technique for three-dimensional shape measurement[J]. Opt Eng, 2006, 45(1): 013602. doi: 10.1117/1.2151160

    CrossRef Google Scholar

    [13] Heikkila J. Geometric camera calibration using circular control points[J]. IEEE Trans Pattern Anal Mach Intell, 2000, 22(10): 1066–1077. doi: 10.1109/34.879788

    CrossRef Google Scholar

    [14] 霍炬, 杨卫, 杨明. 基于消隐点几何特性的摄像机自标定方法[J]. 光学学报, 2010, 30(2): 465–472.

    Google Scholar

    Huo J, Yang W, Yang M. A self-calibration technique based on the geometry property of the vanish point[J]. Acta Opt Sin, 2010, 30(2): 465–472.

    Google Scholar

    [15] Zhang Z Y. Flexible camera calibration by viewing a plane from unknown orientations[C]//Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, 1: 666–673.

    Google Scholar

    [16] Zhang Z H. Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques[J]. Opt Lasers Eng, 2012, 50(8): 1097–1106. doi: 10.1016/j.optlaseng.2012.01.007

    CrossRef Google Scholar

    [17] 王娜, 张启灿, 麻珂. 基于彩色编码条纹投影的孤立物体三维测量[J]. 光电子·激光, 2010, 21(8): 1227–1231.

    Google Scholar

    Wang N, Zhang Q C, Ma K. 3-D shape measurement for isolated objects based on color-encoded fringe projection[J]. J Optoelectron•Laser, 2010, 21(8): 1227–1231.

    Google Scholar

    [18] 刘大海, 林斌. 利用强度调制消除零频的傅里叶变换轮廓测量[J]. 光子学报, 2011, 40(11): 1697–1701.

    Google Scholar

    Liu D H, Lin B. Fourier transform profilometry using zero frequency elimination based on gray modulation[J]. Acta Photon Sin, 2011, 40(11): 1697–1701.

    Google Scholar

    [19] Huang P S, Zhang S. Fast three-step phase-shifting algorithm[J]. Appl Opt, 2006, 45(21): 5086–5091. doi: 10.1364/AO.45.005086

    CrossRef Google Scholar

    [20] Lu J, Mo R, Sun H B, et al. Invalid phase values removal method for absolute phase recovery[J]. Appl Opt, 2016, 55(2): 387–394. doi: 10.1364/AO.55.000387

    CrossRef Google Scholar

    [21] Nellros F, Thurley M J, Jonsson H, et al. Automated measurement of sintering degree in optical microscopy through image analysis of particle joins[J]. Pattern Recognit, 2015, 48(11): 3451–3465. doi: 10.1016/j.patcog.2015.05.012

    CrossRef Google Scholar

    [22] Chen N Q, Wang J J, Yu L A, et al. Sub-pixel edge detection of led probes based on canny edge detection and iterative curve fitting[C]//2014 International Symposium on Computer, Consumer and Control, 2014, 6: 131–134.

    Google Scholar

    [23] Yuen H K, Princen J, Illingworth J, et al. Comparative study of Hough transform methods for circle finding[J]. Image Vis Comput, 1990, 8(1): 71–77. doi: 10.1016/0262-8856(90)90059-E

    CrossRef Google Scholar

    [24] Tsai R Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses[J]. IEEE J Robot Autom, 1987, 3(4): 323–344. doi: 10.1109/JRA.1987.1087109

    CrossRef Google Scholar

    [25] Kaehler A, Bradski G. Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library[M]. Beijing: O'Reilly Media, Inc. , 2016.

    Google Scholar

    [26] 王珊, 徐晓. 基于双目单视面的三维重建[J]. 光学学报, 2017, 37(5): 0515004.

    Google Scholar

    Wang S, Xu X. 3D reconstruction based on horopter[J]. Acta Opt Sin, 2017, 37(5): 0515004.

    Google Scholar

    [27] 孙军华, 杨扬, 张广军. 基于相移的彩色结构光编码三维扫描技术[J]. 光学技术, 2008, 34(1): 122–125. doi: 10.3321/j.issn:1002-1582.2008.01.011

    CrossRef Google Scholar

    Sun J H, Yang Y, Zhang G J. Three dimensional scanning technique using color structured light patterns based on phase moving coding strategy[J]. Opt Tech, 2008, 34(1): 122–125. doi: 10.3321/j.issn:1002-1582.2008.01.011

    CrossRef Google Scholar

  • Overview: In the past two decades, camera calibration theory has been continuously developed and improved. The calibration method based on planar two-dimensional targets has been most widely applied. In the actual calibration process, the captured target images would appear to various degrees of blurring due to environmental factors and camera focus errors. The accuracy of feature point extraction would be affected. Since the phase information is not influenced by the blur of the captured image, some scholars have proposed using a liquid crystal display panel that displays phase patterns as a calibration target. The phase code is used to establish the correspondence between feature point world coordinates and image coordinates to achieve high-precision calibration of the camera. Compared with the calibration method based on Fourier analysis, the calibration method based on phase shift theory has higher accuracy. However, its calibration process is cumbersome because multiple images need to be collected for each target pose. Furthermore, such calibration methods require human intervention when extracting feature points, that is, manually selecting four outer corner points to determine a target area for feature point extraction. The calibration process is complicated.

    This paper proposes a calibration method based on the color-coded phase-shifted fringe to overcome the shortcomings of the calibration method based on phase-shifted theory. This method encoded a phase-shifted stripe through the RGB channels of a color pattern and used a liquid crystal display panel as a calibration target to sequentially display horizontal and vertical color-coded phase-shifted stripes. Through the color channel separation, orthogonal phase-shifted fringes were obtained. The intersection point of the orthogonal phase truncation line was taken as the characteristic point according to the phase-shifted theory. Applied the calibration theory based on the planar two-dimensional target, the calibration of the single-camera and binocular system was realized by changing the target pose multiple times and extracting feature points. Furthermore, calibration efficiency was improved by adding color-coded phase-shifted rings to the four corners of the target pattern to automatically extract and sort feature points. The single-camera calibration experiment shows that when the target pattern is blurred, the calibration accuracy of the method in this paper is significantly better than that of the chessboard target under the premise that the calibration target pose changes the same number of times. It is slightly higher than the orthogonal sinusoidal fringe target and slightly lower than the orthogonal sinusoidal phase-shifted fringe target. The experiment also shows that the number of pictures collected by this method is only one-third of the orthogonal sinusoidal phase-shifted fringe target. When the total number of collected pictures is the same, the reprojection error of this calibration method is the smallest and the precision is the highest. The calibration accuracy is stable under different defocusing degrees. The binocular system calibration experiment shows that the system has high measurement accuracy after calibration, and it can realize 3D reconstruction of the measured object.

  • 加载中
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Figures(10)

Tables(6)

Article Metrics

Article views(5264) PDF downloads(1570) Cited by(0)

Access History

Other Articles By Authors

Article Contents

Catalog

    /

    DownLoad:  Full-Size Img  PowerPoint