Abstract: A method extracting moving object is proposed by utilizing the information fusion. Color image segmentation primarily uses a non-parametric clustering method based on partial space information intervening iterative mean shift procedure. A way of finding connected areas with identical marks is introduced to divide the image into different independent areas. HOS(Higher-Order Statistics) is used for motion detection. Then through post-processing, A rough motion template can be got. In such a template, the ratio of regions with identical marks to the corresponding independent region in the original image can be computed. If the ratio is larger than a predetermined threshold, the corresponding independent region will be fused. Finally, the moving object can be extracted by fusing all the predetermined regions to be fused.