一种快速、鲁棒的压缩视频光流场估计算法
doi: 10.3724/SP.J.1146.2006.00175
A Fast, Robust Optical Flow Estimation Method for Compressed Video
-
摘要: 该文针对视频运动特性的快速分析需求,提出了一种压缩域中的光流场估计算法。首先利用DCT变换后的两个AC系数估计出图像的空间偏导数,在此基础上再利用预测残差以及运动矢量对图像的时间偏导数进行估计。另外对编码过程中未进行前向运动预测的宏块特性进行了详细的分析,给出了这些宏块相对于前向参考帧的运动信息估计方法,并对时域不连续的图像块给出了一种修正的偏导数估计方法,以此解决遮挡、切换等现象。然后通过最小二乘法并结合图像的偏导数进行光流场估计。实验表明该方法在准确度上可以达到或超过像素域中的L-K估计方法,比起现有的压缩域估计方法也有一定提高,而在计算时间上相比像素域估计有了大幅度降低。Abstract: To analyze quickly the motion information of videos, a fast optical flow estimation algorithm for compressed domain is proposed. Firstly the spatial partial derivatives of image luminance are estimated by using two AC coefficients, and then the predictive residual errors and motion vectors of blocks are appended to estimate the temporal partial derivatives. In addition, after the detailed analysis of those macro-blocks that had no forward motion estimation, the motion information is given approximatively relative to their forward reference frames. And then, a amendatory partial derivative estimation is given for the inconsecutive image blocks when occlusion and cut had happened. Finally, optical flow estimation is performed based on the least square method and partial derivative estimation. Experiments indicated that this method can more accurately estimate the optical flow than the L-K method in pixel domain and the exist method in compressed domain. Moreover the proposed method can greatly reduce the compute time than the estimation in pixel domain.
-
Horn B and Schunck G. Determining optical flow[J].Artificial Intelligence.1981, 17(1-3):185-203[2]Lucas B, and Kanade T. An iterative image registration technique with an application to stereo vision[A]. Proceeding the 7th International Joint Conference on Artificial Intelligence[C], Vancouver, 1981: 674-679.[3]Nagel H H. Constrains for the estimation of displacement vector fields from image sequences [A]. Proceeding International Joint Conference on Artificial Intelligence[C], Karlsruhe, Germany, 1983: 945-951.[4]Seferidis V. General approach to block-matching motion estimation[J]. Optical Engineering, 1993, 32(1): 79-91.[5]Lai J, Gauch J, and Crisman J. Computing optical flow in color image sequences[J]. Innovation and Technology in Biology and Medicine, 1994, 15(3): 76-87.[6]Snyder M A. On the mathematical foundations of smoothness constraints for the determination of optical flow and for surface reconstruction[J].IEEE Trans. on Pattern Analysis and Machine Intelligence.1991, 13(11):1105-1114[7]Coimbra M T and Davies M. Approximating optical flow within the MPEG-2 compressed domain[J].IEEE Trans.on Circuits and Systems for Video Technology.2005, 15(1):103-[8]Yeo B and Liu B. On the extraction of DC sequence from MPEG compressed video[A]. Proceeding ICIP[C], Washington, DC, USA, IEEE, 1995, 2: 260-263.
计量
- 文章访问数: 3398
- HTML全文浏览量: 85
- PDF下载量: 925
- 被引次数: 0