Abstract: Though traditional meanshift method has the virtue of simplicity and availability, it does not work well when the target gets an occlusion. In the meanwhile, particle filter can solve this problem easily. Unfortunately, its performance relies heavily on the numbers of the used particles. It makes the tracking technique by particle filtering have difficulty in satisfying the requirement of real time computing. To settle the problem, this article brings about a hybrid algorithm by combining the mean shift and the particle filter tracking technique on the basis of the color histogram distribution. By adopting the strategy that the number of particles is adaptively determined, it amalgamates the virtues of the two techniques. It reduces the computational cost and ensures the performance simultaneously. The experimental results show that the proposed method is effective and robust.