A Fast and Adaptive Digital Image Stabilization Method Based on Multi-block Collaboration

ZHAI Bo; ZHENG Jin; LIU Yangke

doi:10.11999/JEIT150875

Volume 38 Issue 5

May 2016

Turn off MathJax

Article Contents

Article Navigation > Journal of Electronics & Information Technology > 2016 > 38(5): 1107-1114

ZHAI Bo, ZHENG Jin, LIU Yangke. A Fast and Adaptive Digital Image Stabilization Method Based on Multi-block Collaboration[J]. Journal of Electronics & Information Technology, 2016, 38(5): 1107-1114. doi: 10.11999/JEIT150875

Citation:

ZHAI Bo, ZHENG Jin, LIU Yangke. A Fast and Adaptive Digital Image Stabilization Method Based on Multi-block Collaboration[J]. Journal of Electronics & Information Technology, 2016, 38(5): 1107-1114. doi: 10.11999/JEIT150875

Citation:

PDF( 7343 KB)

A Fast and Adaptive Digital Image Stabilization Method Based on Multi-block Collaboration

doi: 10.11999/JEIT150875

1.
(School of Computer Science and Engineering, Beihang University, Beijing 100191, China)
2.

Funds:

The National Natural Science Foundation of China (61370124), The National 863 Program of China (2014AA 015104), Scholarship Foundation of China (20130307020)

Received Date: 2015-07-23
Rev Recd Date: 2015-12-11
Publish Date: 2016-05-19

Abstract

Abstract

The classical digital image stabilization system usually suffers from the problems of low precision and hardly real time processing. This paper presents a fast and robust digital image stabilization method. The sub-pixel phase correlation is used for local registration, and the global motion is collaboratively obtained according to the consistency of local motions, which can decrease the calculation while maintain the precision and tolerable stabilization range. The stationary and consistency assessments of intentional movement are proposed, which are used as feedbacks to adjust the parameter online for Kalman filter. Finally, according to the shaking character of frames, the adjacent frames are stored selectively to save storage resources and better compensation effect is achieved. Experiments show that the proposed method is accurate and robust, and can be used for real-time digital image stabilization products.
- Digital image stabilization,
- Multi-block collaboration,
- Sub-pixel,
- Stabilization,
- Consistency

FullText(HTML)

References(24)

References

朱娟娟. 电子稳像理论及其应用研究[D]. [博士论文], 西安电子科技大学, 2009.

ZHU Juanjuan. Research on theory and application of electronic image stabilization[D]. [Ph. D. dissertation], Xidian University, 2009.

ZHANG Haolong, WU Qiang, LIU Tianqi, et al. Design and implementation of electronic image stabilization system based on dual-core DSP[C]. International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Beijing, 2013: 117-120. doi: 10.1109/IIH-MSP. 2013.38.

时永刚, 周渝斌, 赵跃进. 实时电子数字稳像系统并行处理的快速实现[J]. 电子与信息学报, 2006, 28(7): 1175-1179.

SHI Yonggang, ZHOU Yubin, and ZHAO Yuejin. Fast parallel implementation of real-time electronic digital image stabilization system[J]. Journal of Electronics Information Technology, 2006, 28(7): 1175-1179.

HAQUE M N, BISWAS M, PICKERING M R, et al. A low-complexity image registration algorithm for global motion estimation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(3): 426-433. doi: 10.1109/TCSVT.2011.2163983.

吴浩, 邓宏彬. 一种基于分块灰度投影运动估计的视频稳像方法[J]. 兵工学报，2013, 34(4): 406-411. doi: 10.3969/j.issn. 1000-1093.2013.04.004.

WU Hao and DENG Hongbin. A video stabilization method based on sub-block gray projection[J]. Acta Armamentaii, 2013, 34(4): 406-411. doi: 10.3969/j.issn.1000-1093.2013. 04.004.

余家林, 孙季丰, 宋治国. 基于优选特征轨迹的全分辨率视频稳定[J]. 电子信息学报, 2015, 37(5): 1141-1148. doi: 10.11999/JEIT141019.

YU Jialin, SUN Jifeng, and SONG Zhiguo. Full-frame video stabilization based on preferred feature trajectories[J]. Journal of Electronics Information Technology, 2015, 37(5): 1141-1148. doi: 10.11999/JEIT141019.

KIM S W, YIN S, YUN K, et al. Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization[J]. Elsevier Computer Vision and Image Understanding, 2014, 118: 71-83. doi: 10.1016/j.cviu. 2013.09.005.

于白, 胡叶凤, 郑锦, 等. 基于下采样和亚像素相位相关的全局运动估计[C]. 第十三届全国图形图像学术会议, 南京, 2006: 450-453.

YU Bai, HU Yefeng, ZHENG Jin, et al. Global motion estimation based on sub-sampling and sub-pixel phase correlation[C]. The National Conference on Image and Graphics, Nanjing, 2006: 450-453.

ALFONSO A, FLAVIO V G, EDGAR R A S, et al. Phase correlation with subpixel accuracy: a comparative study in 1D and 2D[J]. Elsevier Computer Vision and Image Understanding, 2015, 137: 76-87. doi: 10.1016/j.cviu. 2015.03.011.

ERTURK S. Digital image stabilization with subimage phase correlation based global motion estimation[J]. IEEE Transactions on Consumer Electronics, 2003, 49(4): 13201325. doi: 10.1109/TCE.2003.1261235.

LI Lengyi, MA Xiaohong, and ZHAO Zheng. Real-time video stabilization based on fast block matching and improved Kalman filter[C]. IEEE International Conference on Intelligent Control and Information Processing (ICICIP), Dalian, 2014: 394-397. doi: 10.1109/ICICIP.2014.7010285.

罗雨, 王永庆, 罗海坤, 等. 基于扩展卡尔曼滤波器的矢量跟踪算法研究[J]. 电子与信息学报, 2013, 35(6): 1400-1405. doi: 10.3724/SP.J.1146.2012.00828.

LUO Yu, WANG Yongqing, LUO Haikun, et al. Study on vector tracking loop based on extended Kalman filter[J]. Journal of Electronics Information Technology, 2013, 35(6): 1400-1405. doi: 10.3724/SP.J.1146.2012.00828.

董晶, 杨夏, 于起峰. 基于单应轨迹的视频实时稳像算法[J]. 国防科技大学学报, 2014, 36(2): 99-104. doi: 10.11887/j.cn. 201402017.

DONG Jing, YANG Xia, and YU Qifeng. A real-time video stabilization algorithm based on homography trajectory[J]. Journal of National University of Defense Technology, 2014, 36(2): 99-104. doi: 10.11887/j.cn.201402017.

YEON G R and MYUNG J C. Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J]. IEEE Signal Processing Letters, 2012, 19(4): 223-226. doi: 10.1109/ LSP.2012.2188286.

MAI Ying, ZHAO Hongying, and GUO Shiyi. The analysis of image stabilization technology based on small-UAV airborne video[C]. IEEE International Conference on Computer Science and Electronics Engineering, Hangzhou, 2012: 586-589. doi: 10.1109/ICCSEE.2012.77.

MATSUSHITA Y, OFEK E, WEINA G, et al. Full-frame video stabilization with motion inpainting[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(7): 1150-1163. doi: 10.1109/TPAMI.2006.141.

TANG Chongwu, YANG Xiaokang, CHEN Li, et al. A fast video stabilization algorithm based on block matching and edge completion[C]. IEEE International Workshop on Multimedia Signal Processing (MMSP), Hangzhou, 2011: 1-5. doi: 10.1109/MMSP.2011.6093781.

Relative Articles

Supplements(0)

Cited By

Proportional views