Recently, a great number of interests have been attracted to perceptual video coding. In this paper, perceptual video coding and especially perceptual three-dimensional video coding are reviewed. Firstly, single-view video coding is analyzed by utilizing perceptual characteristics of human visual system including luminance, contrast sensitivity, fovea, etc, and then their problems are analyzed. Secondly, the perceptual three-dimensional video coding based on the region of interest and binocular sensitivity characteristics are discussed and analyzed. Finally, several future research directions for this technology and research field are discussed.