The installation of binocular vision at the end of a manipulator reduces its availability in environments with obstacles. To deal with the problem, this study puts forward a target localization method using a laser and the monocular hand-eye vision. In the proposed method, the centre of the laser spot is obtained by the hand-eye vision, and the geometric relations among the laser emission point, light-spot and the optical axis of the camera are used to calculate the distance. Then, the D-H method is employed to construct the coordinate conversion system, so that the location of the target can be calculated. The measuring precision is negatively correlated with the distance, and it is suitable for the measurement in medium or short distance. Compared with the commonly used binocular measurement methods, the proposed method uses fewer cameras, which reduces the width of the measurement system on manipulators, and makes it more applicable to narrow workspace. Moreover, it also improves the effective load capacity of manipulators.
A target localization method with monocular hand-eye vision
First published at:May 01, 2018
1 Siegwart R, Nourbakhsh I R. Introduction to autonomous mobile robots[M]. Cambridge, MA: MIT Press, 2004: 3-45.
2 Chaudhury A, Ward C, Talasaz A, et al. Computer vision based autonomous robotic system for 3D plant growth measurement[C]//Proceedings of the IEEE 12th Conference on Computer and Robot Vision (CRV), Halifax, Canada, 2015: 290-296.
3 Iguchi Y, Yamaguchi J. Omni-directional 3D measurement using double fish-eye stereo vision[C]//Proceedings of the IEEE 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Mokpo, Korea, 2015: 1-6.
4 Huang W Y, Xu X M, Wu F Q, et al. Research of underwater binocular vision stereo positioning technology in nuclear condition[J]. Opto-Electronic Engineering, 2016, 43(12): 28-33.
5 He T, Chen J Y, Hu X, et al. A study of 3D coordinate measuring based on binocular stereo vision[J]. Applied Mechanics and Materials, 2015, 740: 531-534. DOI:10.4028/www.scientific.net/AMM.740
6 Wei S P, Yan H M, Zhang X D. Disparity estimation based on the combination of depth camera and stereo vision[J]. Opto-Electronic Engineering, 2015, 42(7): 72-77.
7 An X C, Hong W, Xia H. Research on binocular vision absolute localization method for indoor robots based on natural landmarks[C]//Proceedings of 2015 IEEE Chinese Automation Congress (CAC), Wuhan, 2015: 604-609.
8 Nefti-Meziani S, Manzoor U, Davis S, et al. 3D Perception from binocular vision for a low cost humanoid robot NAO[J]. Robotics and Autonomous Systems, 2015, 68: 129-139. DOI:10.1016/j.robot.2014.12.016
9 Li H, Li B, Xu W F. Development of a remote-controlled mobile robot with binocular vision for environment monitoring[C]//Proceedings of 2015 IEEE International Conference on Information and Automation, Lijiang, 2015: 737-742.
10 Urmson C, Anhalt J, Bagnell D, et al. Autonomous driving in urban environments: boss and the urban challenge[J]. Journal of Field Robotics, 2008, 25(8): 425-466. DOI:10.1002/rob.v25:8
11 Fanello S R, Pattacini U, Gori I, et al. 3D stereo estimation and fully automated learning of eye-hand coordination in humanoid robots[C]//Proceedings of the 14th IEEE-RAS International Conference on Humanoid Robots (Humanoids), Madrid, Spain, 2014: 1028-1035.
12 Chao F, Lee M H, Jiang M, et al. An infant development-inspired approach to robot hand-eye coordination[J]. International Journal of Advanced Robotic Systems, 2014, 11(2): 15. DOI:10.5772/57555
13 Henry P, Krainin M, Herbst E, et al. RGB-D mapping: using Kinect-style depth cameras for dense 3D modeling of indoor environments[J]. The International Journal of Robotics Research, 2012, 31(5): 647-663. DOI:10.1177/0278364911434148
14 Huang F S. Study on the key technique of single camera 3D coordinate vision measurement system using a light pen[D]. Tianjin: Tianjin University, 2005.
15 Aroca R V, Burlamaqui A F, Gon alves L M G. Method for reading sensors and controlling actuators using audio interfaces of mobile devices[J]. Sensors, 2012, 12(2): 1572-1593. DOI:10.3390/s120201572
16 Xu D, Calderon C A A, Gan J Q, et al. An analysis of the Inverse Kinematics for a 5-DOF manipulator[J]. International Journal of Automation and Computing, 2005, 2(2): 114-124. DOI:10.1007/s11633-005-0114-1
17 Craig J J. Introduction to robotics: mechanics and control[M]. 3rd ed. London: Pearson Education, 2005: 62-120.
18 da Graça Marcos M, Machado J A T, Azevedo-Perdicoulis T P. An evolutionary approach for the motion planning of redundant and hyper-redundant manipulators[J]. Nonlinear Dynamics, 2010, 60(1-2): 115-129. DOI:10.1007/s11071-009-9584-y
Supported by National Natural Science Foundation of China (61503108) and Natural Science Foundation of Zhejiang Province (LY17F030022)
Get Citation: Zhang Botao, Zhong Chaoliang, Wu Qiuxuan. A target localization method with monocular hand-eye vision[J]. Opto-Electronic Engineering, 2018, 45(5): 170696.