一种多子块协同的自适应快速数字稳像方法

翟博; 郑锦; 刘养科

doi:10.11999/JEIT150875

一种多子块协同的自适应快速数字稳像方法

doi: 10.11999/JEIT150875

1.
(北京航空航天大学计算机学院北京 100191) ②(防空兵学院郑州 450052)

基金项目:

国家自然科学基金(61370124)，国家863计划项目(2014AA015104)，国家留学基金(20130307020)

计量
- 文章访问数: 1238
- HTML全文浏览量: 64
- PDF下载量: 412
- 被引次数: 0
出版历程
- 收稿日期: 2015-07-23
- 修回日期: 2015-12-11
- 刊出日期: 2016-05-19

A Fast and Adaptive Digital Image Stabilization Method Based on Multi-block Collaboration

1.
(School of Computer Science and Engineering, Beihang University, Beijing 100191, China)

Funds:

The National Natural Science Foundation of China (61370124), The National 863 Program of China (2014AA 015104), Scholarship Foundation of China (20130307020)

摘要

摘要: 针对现有数字稳像系统稳像精度低、难以实时处理的问题，该文提出一种快速鲁棒的数字视频稳像方法。采用亚像素相位相关对图像子块进行局部匹配，根据局部运动的一致性，利用多子块协同获取全局运动矢量，在减少计算量的同时保证了稳像精度与范围；进而提出主动运动平稳性和一致性两种度量，利用其反馈调整卡尔曼滤波参数，实现主动运动和抖动的准确分离；最后根据帧间抖动特点选择邻近适合图像进行存储，在节省存储资源的同时达到较好的补偿效果。实验结果表明，该文提出的稳像方法具有较高的稳像精度以及较强的抗干扰能力，可用于实时电子稳像产品。
- 数字稳像 /
- 多子块协同 /
- 亚像素 /
- 平稳性 /
- 一致性
Abstract: The classical digital image stabilization system usually suffers from the problems of low precision and hardly real time processing. This paper presents a fast and robust digital image stabilization method. The sub-pixel phase correlation is used for local registration, and the global motion is collaboratively obtained according to the consistency of local motions, which can decrease the calculation while maintain the precision and tolerable stabilization range. The stationary and consistency assessments of intentional movement are proposed, which are used as feedbacks to adjust the parameter online for Kalman filter. Finally, according to the shaking character of frames, the adjacent frames are stored selectively to save storage resources and better compensation effect is achieved. Experiments show that the proposed method is accurate and robust, and can be used for real-time digital image stabilization products.
- Digital image stabilization /
- Multi-block collaboration /
- Sub-pixel /
- Stabilization /
- Consistency

HTML全文

参考文献(24)

朱娟娟. 电子稳像理论及其应用研究[D]. [博士论文], 西安电子科技大学, 2009.

ZHU Juanjuan. Research on theory and application of electronic image stabilization[D]. [Ph. D. dissertation], Xidian University, 2009.

ZHANG Haolong, WU Qiang, LIU Tianqi, et al. Design and implementation of electronic image stabilization system based on dual-core DSP[C]. International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Beijing, 2013: 117-120. doi: 10.1109/IIH-MSP. 2013.38.

时永刚, 周渝斌, 赵跃进. 实时电子数字稳像系统并行处理的快速实现[J]. 电子与信息学报, 2006, 28(7): 1175-1179.

SHI Yonggang, ZHOU Yubin, and ZHAO Yuejin. Fast parallel implementation of real-time electronic digital image stabilization system[J]. Journal of Electronics Information Technology, 2006, 28(7): 1175-1179.

HAQUE M N, BISWAS M, PICKERING M R, et al. A low-complexity image registration algorithm for global motion estimation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(3): 426-433. doi: 10.1109/TCSVT.2011.2163983.

吴浩, 邓宏彬. 一种基于分块灰度投影运动估计的视频稳像方法[J]. 兵工学报，2013, 34(4): 406-411. doi: 10.3969/j.issn. 1000-1093.2013.04.004.

WU Hao and DENG Hongbin. A video stabilization method based on sub-block gray projection[J]. Acta Armamentaii, 2013, 34(4): 406-411. doi: 10.3969/j.issn.1000-1093.2013. 04.004.

余家林, 孙季丰, 宋治国. 基于优选特征轨迹的全分辨率视频稳定[J]. 电子信息学报, 2015, 37(5): 1141-1148. doi: 10.11999/JEIT141019.

YU Jialin, SUN Jifeng, and SONG Zhiguo. Full-frame video stabilization based on preferred feature trajectories[J]. Journal of Electronics Information Technology, 2015, 37(5): 1141-1148. doi: 10.11999/JEIT141019.

KIM S W, YIN S, YUN K, et al. Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization[J]. Elsevier Computer Vision and Image Understanding, 2014, 118: 71-83. doi: 10.1016/j.cviu. 2013.09.005.

于白, 胡叶凤, 郑锦, 等. 基于下采样和亚像素相位相关的全局运动估计[C]. 第十三届全国图形图像学术会议, 南京, 2006: 450-453.

YU Bai, HU Yefeng, ZHENG Jin, et al. Global motion estimation based on sub-sampling and sub-pixel phase correlation[C]. The National Conference on Image and Graphics, Nanjing, 2006: 450-453.

ALFONSO A, FLAVIO V G, EDGAR R A S, et al. Phase correlation with subpixel accuracy: a comparative study in 1D and 2D[J]. Elsevier Computer Vision and Image Understanding, 2015, 137: 76-87. doi: 10.1016/j.cviu. 2015.03.011.

ERTURK S. Digital image stabilization with subimage phase correlation based global motion estimation[J]. IEEE Transactions on Consumer Electronics, 2003, 49(4): 13201325. doi: 10.1109/TCE.2003.1261235.

LI Lengyi, MA Xiaohong, and ZHAO Zheng. Real-time video stabilization based on fast block matching and improved Kalman filter[C]. IEEE International Conference on Intelligent Control and Information Processing (ICICIP), Dalian, 2014: 394-397. doi: 10.1109/ICICIP.2014.7010285.

罗雨, 王永庆, 罗海坤, 等. 基于扩展卡尔曼滤波器的矢量跟踪算法研究[J]. 电子与信息学报, 2013, 35(6): 1400-1405. doi: 10.3724/SP.J.1146.2012.00828.

LUO Yu, WANG Yongqing, LUO Haikun, et al. Study on vector tracking loop based on extended Kalman filter[J]. Journal of Electronics Information Technology, 2013, 35(6): 1400-1405. doi: 10.3724/SP.J.1146.2012.00828.

董晶, 杨夏, 于起峰. 基于单应轨迹的视频实时稳像算法[J]. 国防科技大学学报, 2014, 36(2): 99-104. doi: 10.11887/j.cn. 201402017.

DONG Jing, YANG Xia, and YU Qifeng. A real-time video stabilization algorithm based on homography trajectory[J]. Journal of National University of Defense Technology, 2014, 36(2): 99-104. doi: 10.11887/j.cn.201402017.

YEON G R and MYUNG J C. Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J]. IEEE Signal Processing Letters, 2012, 19(4): 223-226. doi: 10.1109/ LSP.2012.2188286.

MAI Ying, ZHAO Hongying, and GUO Shiyi. The analysis of image stabilization technology based on small-UAV airborne video[C]. IEEE International Conference on Computer Science and Electronics Engineering, Hangzhou, 2012: 586-589. doi: 10.1109/ICCSEE.2012.77.

MATSUSHITA Y, OFEK E, WEINA G, et al. Full-frame video stabilization with motion inpainting[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(7): 1150-1163. doi: 10.1109/TPAMI.2006.141.

TANG Chongwu, YANG Xiaokang, CHEN Li, et al. A fast video stabilization algorithm based on block matching and edge completion[C]. IEEE International Workshop on Multimedia Signal Processing (MMSP), Hangzhou, 2011: 1-5. doi: 10.1109/MMSP.2011.6093781.

施引文献

资源附件(0)

访问统计