Abstract: In this paper, the intrinsic relationship between registration accuracy and probability of residues referred to in phase unwrapping is investigated. Based on the derived model, it is presented that the number of residues can be used as a criterion to judge the registration results and select the optimal phase fringe image, which will reduce the error caused by misregistration as possible as much. The experiments show the effectiveness of this approach.