Fringe projection based three-dimensional measurement system by the light-source-stepping method using LD

Ying Xiaolin; Yao Jianyun; Zhang Xiaosong; Chu Dongya; Li Yong

doi:10.12086/oee.2021.210298

Article navigation > Opto-Electronic Engineering > 2021 Vol. 48 > No. 11 > 210298

Next Article Previous Article

Ying X L, Yao J Y, Zhang X S, et al. Fringe projection based three-dimensional measurement system by the light-source-stepping method using LD[J]. Opto-Electron Eng, 2021, 48(11): 210298. doi: 10.12086/oee.2021.210298

Citation:

Ying X L, Yao J Y, Zhang X S, et al. Fringe projection based three-dimensional measurement system by the light-source-stepping method using LD[J]. Opto-Electron Eng, 2021, 48(11): 210298. doi: 10.12086/oee.2021.210298

Fringe projection based three-dimensional measurement system by the light-source-stepping method using LD

1.
Institute of Information Optics, Zhejiang Normal University, Jinhua, Zhejiang 321004, China
2.
Key Laboratory of Optical Information Detecting and Display Technology of Zhejiang Province, Jinhua, Zhejiang 321004, China

Fund Project: the Natural Science Foundation of Zhejiang Province (LY17F050002)

More Information

^*Corresponding author: Li Yong, E-mail: liyong@zjnu.cn

Received Date 14 September 2021

Revised Date 26 October 2021

Published Date 15 November 2021

Abstract

Abstract

In the three-dimensional (3D) measurement system by the light-source-stepping method using LED, due to the large divergence angle of LED, the large fringe projection area can be achieved in a short distance, resulting in a short working distance of the system. In addition, the large luminous size of high-power LED leads to low fringe contrast, and it is difficult to project fringes with high brightness and high contrast. To solve the above problems, it is proposed to use laser diode (LD) as the light source to realize high brightness and high contrast phase-shift fringe projection in the light-source-stepping projection device. A portable and high-speed three-dimensional measurement system is designed by using the projection device and binocular camera. Firstly, an improved Fourier transform profilometry is used to obtain the phase and modulation of deformed fringe. Secondly, using the randomness of laser speckle, the rough matching of the binocular image is realized in the modulation map. Then, the fringe phase is unwrapped on the basis of rough matching, and the phase is used to realize fine matching. Finally, the three-dimensional shape of the object to be measured is obtained. The experimental verification is carried out by using the designed system. The measurement volume of the system is 360 mm×290 mm×100 mm, and the maximum 3D point captured is 1280×1024 points. The 3D shape measurement speed of 100 f/s was achieved. The measurement standard deviation of the plane is 0.19 mm. Five planes with a distance of 1.00 mm were measured, and the average error of the measurement distance is 0.05 mm.
- optical three-dimensional shape measurement /
- fringe projection /
- Fourier transform profilometry /
- binocular stereo vision

FullText(HTML)

References

[1]	Gen J. Structured-light 3D surface imaging: a tutorial[J]. Adv Opt Photon, 2011, 3(2): 128–160. doi: 10.1364/AOP.3.000128 CrossRef Google Scholar
[2]	苏显渝, 张启灿, 陈文静. 结构光三维成像技术[J]. 中国激光, 2014, 41(2): 0209001. Google Scholar Su X Y, Zhang Q C, Chen W J. Three-dimensional imaging based on structured illumination[J]. Chin J Lasers, 2014, 41(2): 0209001. Google Scholar
[3]	李勇, 张广汇, 马利红, 等. 条纹投影动态三维表面成像技术综述[J]. 红外与激光工程, 2020, 49(3): 0303005. Google Scholar Li Y, Zhang G H, Ma L H, et al. Review of dynamic three-dimensional surface imaging based on fringe projection[J]. Infrared Laser Eng, 2020, 49(3): 0303005. Google Scholar
[4]	Srinivasan V, Liu H C, Halioua M. Automated phase-measuring profilometry of 3-D diffuse objects[J]. Appl Opt, 1984, 23(18): 3105–3108. doi: 10.1364/AO.23.003105 CrossRef Google Scholar
[5]	Guan Y J, Yin Y K, Li A M, et al. Dynamic 3D imaging based on acousto-optic heterodyne fringe interferometry[J]. Opt Lett, 2014, 39(12): 3678–3681. doi: 10.1364/OL.39.003678 CrossRef Google Scholar
[6]	Xian T, Su X Y. Area modulation grating for sinusoidal structure illumination on phase-measuring profilometry[J]. Appl Opt, 2001, 40(8): 1201–1206. doi: 10.1364/AO.40.001201 CrossRef Google Scholar
[7]	Heist S, Mann A, Kühmstedt P, et al. Array projection of aperiodic sinusoidal fringes for high-speed three-dimensional shape measurement[J]. Opt Eng, 2014, 53(11): 112208. doi: 10.1117/1.OE.53.11.112208 CrossRef Google Scholar
[8]	Hyun J S, Chiu G T C, Zhang S. High-speed and high-accuracy 3D surface measurement using a mechanical projector[J]. Opt Express, 2018, 26(2): 1474–1487. doi: 10.1364/OE.26.001474 CrossRef Google Scholar
[9]	张海花, 李勇, 张启灿. 基于旋转光栅投影的动态三维面形测量方法[J]. 光学学报, 2021, 41(23): 2312005. Google Scholar Zhang H H, Li Y, Zhang Q C. Dynamic 3D shape measurement method based on rotating grating projection[J]. Acta Opt Sin, 2021, 41(23): 2312005. Google Scholar
[10]	Li Y, Zhao C F, Qian Y X, et al. High-speed and dense three-dimensional surface acquisition using defocused binary patterns for spatially isolated objects[J]. Opt Express, 2010, 18(21): 21628–21635. doi: 10.1364/OE.18.021628 CrossRef Google Scholar
[11]	邢生平, 蔡宁, 林斌. 基于蚁群相位抖动优化的高质量三维形貌测量[J]. 光电工程, 2021, 48(7): 210114. doi: 10.12086/oee.2021.210114 CrossRef Google Scholar Xing S P, Cai N, Lin B. High-quality 3D shape measurement based on ant colony phase jitter optimization[J]. Opto-Electron Eng, 2021, 48(7): 210114. doi: 10.12086/oee.2021.210114 CrossRef Google Scholar
[12]	卢世江, 李勇, 王辉, 等. 含孤立物体场景的高速、高密度三维面形采集[J]. 光电工程, 2012, 39(1): 34–39. doi: 10.3969/j.issn.1003-501X.2012.01.007 CrossRef Google Scholar Lu S J, Li Y, Wang H, et al. High-speed and dense 3D shape capture of scene consisting of spatially isolated objects[J]. Opto-Electron Eng, 2012, 39(1): 34–39. doi: 10.3969/j.issn.1003-501X.2012.01.007 CrossRef Google Scholar
[13]	Zhang S. High-speed 3D shape measurement with structured light methods: a review[J]. Opt Lasers Eng, 2018, 106: 119–131. Google Scholar
[14]	冯晨, 陈文艺, 杨辉. 基于MEMS微振镜的高精度正弦光栅产生方法[J]. 计算机与数字工程, 2018, 46(2): 367–370, 401. doi: 10.3969/j.issn.1672-9722.2018.02.031 CrossRef Google Scholar Feng C, Chen W Y, Yang H. A generation method of high accuracy sinusoidal grating based on MEMS micro-mirror[J]. Comput Digit Eng, 2018, 46(2): 367–370, 401. doi: 10.3969/j.issn.1672-9722.2018.02.031 CrossRef Google Scholar
[15]	Fujigaki M, Oura Y, Asai D, et al. High-speed height measurement by a light-source-stepping method using a linear LED array[J]. Opt Express, 2013, 21(20): 23169–23180. doi: 10.1364/OE.21.023169 CrossRef Google Scholar
[16]	Fujigaki M, Sakaguchi T, Murata Y. Development of a compact 3D shape measurement unit using the light-source-stepping method[J]. Opt Lasers Eng, 2016, 85: 9–17. doi: 10.1016/j.optlaseng.2016.04.016 CrossRef Google Scholar
[17]	Jiang Y T, Li Y, Huang K, et al. New calibration approach for 3D measurement system based on the light-source-stepping method[J]. Proc SPIE, 2019, 11189: 111891J. Google Scholar
[18]	李勇, 苏显渝. 用于可靠性导向相位展开的快速算法[J]. 光电工程, 2005, 32(11): 76–79. doi: 10.3969/j.issn.1003-501X.2005.11.019 CrossRef Google Scholar Li Y, Su X Y. Fast algorithm for reliability-guided phase unwrapping[J]. Opto-Electron Eng, 2005, 32(11): 76–79. doi: 10.3969/j.issn.1003-501X.2005.11.019 CrossRef Google Scholar

Overview

Overview

Overview: Fringe projection based three-dimensional measurement technology has been widely used in reverse engineering, cultural relic protection, medical image, virtual reality, and so on. The fringe projection device (projector) is an essential part of the measurement system based on this technology. The common high-speed projector is expensive and complicated. Fujigaki proposed a light-source-stepping projector using a linear LED array and Ronchi grating. The projector is simple, smaller in size, and cheaper in price. However, a large light-emitting area of high-power LED leads to lower contrast of the fringe, especially the high-density fringe. The large divergence angle of LED leads to the short working distance of the projector. On other hand, the light-emitting area and divergence angle of laser diode (LD) are small. To solve the problems of LED-based projectors, a linear LD array is used as the light source to project phase-shifted fringe with higher brightness and higher contrast. Because LD is a coherent light source, a speckle problem is introduced while improving fringe contrast. Using the randomness of speckle, the speckle in the modulation image is used as a feature for rough matching of homologous points in a binocular system. In the origin system, PMP is used for phase measurement. The measured depth range of the system is small because the phase shift is different at different depths. An improved Fourier transform profilometry is proposed to extend the depth range. A portable and high-speed three-dimensional measurement system is designed by using the projector and binocular camera. The measurement process is as follows. 1) The light-source-stepping method is used to project phase-shifted fringes and the camera is used to take deformation fringes. 2) The two deformed fringe patterns with phase shift are subtracted. Then, Fourier transform, filtering, and inverse Fourier transform are performed successively. Finally, the wrapped phase and modulation are obtained. 3) The modulation image is segmented, and then the homologous points are found by feature matching in the neighborhood near the point with the highest modulation in each non-connected region. 4) The matching points with high reliability are selected, and the phase is unwrapped by using the reliability-guided fast phase unwrapping algorithm. 5) Using the unwrapped phase for fine matching, a high-precision parallax map is obtained. 6) The three-dimensional shape is reconstructed using the parallax. The experimental verification is carried out. The measurement volume of the system is 360 mm×290 mm×100 mm, and the maximum 3D point captured is 1280×1024 points. The 3D shape measurement speed of 100 f/s was achieved. The measurement standard deviation of the plane is 0.19 mm. Five planes with a distance of 1.00 mm are measured, and the average error of the measurement distance is 0.05 mm.