In allusion of the video jitter problem caused by platform motion, a video stabilization technique based on optical flow sensor is presented. Firstly, the scheme improves the general optical flow sensor to output accurate motion vectors under rotational motion, then motion vectors between adjacent frames are obtained by using the optical flow sensor. The real-time translation and rotation information of the main camera are calculated through coordinate transformation. Secondly, the method compensates the motion of video sequences to attain stable video sequences, and finally realizes video stabilization. Experimental results indicate that, compared with the unstable image, the peak signal-to-noise ratio (PSNR) is increased by 11.86 dB. In the case of obvious video jitter, the scheme can significantly reduce the jitter between video sequences. The method which has the characteristics of salutary video stabilization can meet the performance requirements of video stabilization and improve the capacity of disturbance resistance for platform.
Video stabilization technique based on optical flow sensor
First published at:Nov 01, 2019
1 Liu W. Research on the methods of electronic image stabilization for shipborne mobile video[D]. Dalian: Dalian Maritime University, 2017.
2 Zhang B. Research on united image stabilization based on feature tracking and gray projection[D]. Harbin: Harbin Engineering University, 2010.
3 Feng J, Yan Y Y, Zhao Y, et al. A terracotta image partition matching method based on learned invariant feature transform[J]. Optics and Precision Engineering, 2018, 26(7): 1774–1783.
4 Zeng L, Zhai Y, Tan J B. Automatic matching strategy based on SIFT[J]. Opto-Electronic Engineering, 2011, 38(2): 65–70. DOI:10.3969/j.issn.1003-501X.2011.02.011
曾峦, 翟优, 谭久彬.基于SIFT的自动匹配策略[J].光电工程, 2011, 38(2): 65–70. DOI:10.3969/j.issn.1003-501X.2011.02.011
5 Honegger D, Meier L, Tanskanen P, et al. An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications[C]//2013 IEEEInternational Conference on Robotics and Automation, Karlsruhe, 2013: 1736–1741.
6 Long D F, Liu J, Zhang X M, et al. Triaxial gyroscope fast calibration method based on ellipsoid fitting[J]. Chinese Journal of Scientific Instrument, 2013, 34(6): 1299–1305. DOI:10.3969/j.issn.0254-3087.2013.06.015
龙达峰, 刘俊, 张晓明, 等.基于椭球拟合的三轴陀螺仪快速标定方法[J].仪器仪表学报, 2013, 34(6): 1299–1305. DOI:10.3969/j.issn.0254-3087.2013.06.015
7 Ji H Z, Jia D Y, Dong E Q, et al. Non-rigid registrations based on image characteristics and optical flows[J]. Optics and Precision Engineering, 2017, 25(9): 2469–2482.
8 Lan J H, Li J, Hu G D, et al. Vehicle speed measurement based on gray constraint optical flow algorithm[J]. Optik, 2014, 125(1): 289–295. DOI:10.1016/j.ijleo.2013.06.036
9 Huang R M, Li J Q, Shi M Y, et al. Quadrotor hovering scheme based on improved optical flow[C]//2017Chinese Automation Congress (CAC), Jinan, 2017: 2357–2362.
10 Tsai S E, Zhuang S H. Optical flow sensor integrated navigation system for quadrotor in GPS-denied environment[C]//2016International Conference on Robotics and Automation Engineering (ICRAE), Jeju, 2016: 87–91.
11 Xiong J Y. Study of electronic image stabilization based on feature detection and description for vehicles[D]. Changchun: Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, 2017.
12 Zheng X F, Chen Y T, Xu Z H, et al. A fast electronic image stabilization algorithm for translational and rotational motion compensation[J]. Acta Photonica Sinica, 2008, 37(9): 1890–1894.
13 Lv G J, Zhang G H, Che H. A method for evaluating the accuracy of electronic image stabilization system and algorithm[J]. Electronics Optics & Control, 2011, 18(3): 76–79. DOI:10.3969/j.issn.1671-637X.2011.03.019
吕高杰, 张国华, 车宏.电子稳像算法精度评价方法研究[J].电光与控制, 2011, 18(3): 76–79. DOI:10.3969/j.issn.1671-637X.2011.03.019
National Natural Science Foundation of China (61505192), Natural Science Foundation of Zhejiang Province (LQ15F050004, LY20F050008), and Open Foundation of Key Laboratory of Technology and Application for Safeguarding of Marine Rights and Interests, SOA (1705)
Get Citation: Zhou Pengwei, Ji Yuanji, Dong Chao, et al. Video stabilization technique based on optical flow sensor[J]. Opto-Electronic Engineering, 2019, 46(11): 180581.
Previous: Research on the application of RANSAC algorithm in electro-optical tracking of space targets