In allusion of the video jitter problem caused by platform motion, a video stabilization technique based on optical flow sensor is presented. Firstly, the scheme improves the general optical flow sensor to output accurate motion vectors under rotational motion, then motion vectors between adjacent frames are obtained by using the optical flow sensor. The real-time translation and rotation information of the main camera are calculated through coor-dinate transformation. Secondly, the method compensates the motion of video sequences to attain stable video sequences, and finally realizes video stabilization. Experimental results indicate that, compared with the unstable image, the peak signal-to-noise ratio (PSNR) is increased by 11.86 dB. In the case of obvious video jitter, the scheme can significantly reduce the jitter between video sequences. The method which has the characteristics of salutary video stabilization can meet the performance requirements of video stabilization and improve the capacity of disturbance resistance for platform.
Video stabilization technique based on optical flow sensor
First published at:Nov 15, 2019
 Liu W. Research on the methods of electronic image stabilization for shipborne mobile video[D]. Dalian: Dalian Maritime University, 2017.
刘文. 船载移动视频电子稳像方法研究[D]. 大连: 大连海事大学, 2017.
 Zhang B. Research on united image stabilization based on feature tracking and gray projection[D]. Harbin: Harbin Engi-neering University, 2010.
张贝. 基于特征提取与灰度投影联合稳像的算法研究[D]. 哈尔滨: 哈尔滨工程大学, 2010.
 Feng J, Yan Y Y, Zhao Y, et al. A terracotta image partition matching method based on learned invariant feature trans-form[J]. Optics and Precision Engineering, 2018, 26(7): 1774–1783.
冯筠, 延瑜瑜, 赵妍, 等. 基于学习不变特征变换的兵马俑图像分区匹配[J]. 光学 精密工程, 2018, 26(7): 1774–1783.
 Zeng L, Zhai Y, Tan J B. Automatic matching strategy based on SIFT[J]. Opto-Electronic Engineering, 2011, 38(2): 65–70.
曾峦, 翟优, 谭久彬. 基于SIFT的自动匹配策略[J]. 光电工程, 2011, 38(2): 65–70.
 Honegger D, Meier L, Tanskanen P, et al. An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications[C]//2013 IEEE International Conference on Robotics and Automation, Karlsruhe, 2013: 1736–1741.
 Long D F, Liu J, Zhang X M, et al. Triaxial gyroscope fast calibration method based on ellipsoid fitting[J]. Chinese Jour-nal of Scientific Instrument, 2013, 34(6): 1299–1305.
龙达峰, 刘俊, 张晓明, 等. 基于椭球拟合的三轴陀螺仪快速标定方法[J]. 仪器仪表学报, 2013, 34(6): 1299–1305.
 Ji H Z, Jia D Y, Dong E Q, et al. Non-rigid registrations based on image characteristics and optical flows[J]. Optics and Precision Engineering, 2017, 25(9): 2469–2482.
纪慧中, 贾大宇, 董恩清, 等. 基于图像特征和光流场的非刚性图像配准[J]. 光学 精密工程, 2017, 25(9): 2469–2482.
 Lan J H, Li J, Hu G D, et al. Vehicle speed measurement based on gray constraint optical flow algorithm[J]. Optik, 2014, 125(1): 289–295.
 Huang R M, Li J Q, Shi M Y, et al. Quadrotor hovering scheme based on improved optical flow[C]//2017 Chinese Automation Congress (CAC), Jinan, 2017: 2357–2362.
 Tsai S E, Zhuang S H. Optical flow sensor integrated navigation system for quadrotor in GPS-denied environment[C]//2016 In-ternational Conference on Robotics and Automation Engineering (ICRAE), Jeju, 2016: 87–91.
 Xiong J Y. Study of electronic image stabilization based on feature detection and description for vehicles[D]. Changchun: Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, 2017.
熊晶莹. 基于特征提取与匹配的车载电子稳像方法研究[D]. 长春: 中国科学院长春光学精密机械与物理研究所, 2017.
 Zheng X F, Chen Y T, Xu Z H, et al. A fast electronic image stabilization algorithm for translational and rotational motion compensation[J]. Acta Photonica Sinica, 2008, 37(9): 1890–1894.
郑晓锋, 陈跃庭, 徐之海, 等. 一种补偿平移与旋转运动的快速电子稳像算法[J]. 光子学报, 2008, 37(9): 1890–1894.
 Lv G J, Zhang G H, Che H. A method for evaluating the accuracy of electronic image stabilization system and algorithm[J]. Electronics Optics & Control, 2011, 18(3): 76–79.
吕高杰, 张国华, 车宏. 电子稳像算法精度评价方法研究[J]. 电光与控制, 2011, 18(3): 76–79.
National Natural Science Foundation of China (61505192), Natural Science Foundation of Zhejiang Province (LQ15F050004, LY20F050008), and Open Foundation of Key Laboratory of Technology and Application for Safeguarding of Marine Rights and Interests, SOA (1705)
Get Citation: Zhou Pengwei, Ji Yuanji, Dong Chao, et al. Video stabilization technique based on optical flow sensor[J]. Opto-Electronic Engineering, 2019, 46(11): 180581.
Previous: Research on the application of RANSAC algorithm in electro-optical tracking of space targets