基于场景模式的立体图像舒适度客观评价模型

应宏微; 蒋刚毅; 郁梅; 彭宗举; 邵枫

doi:10.11999/JEIT150267

基于场景模式的立体图像舒适度客观评价模型

doi: 10.11999/JEIT150267

2.
(宁波大学信息科学与工程学院宁波 315211) ②(宁波工程学院电子与信息工程学院宁波 315211) ③(南京大学计算机软件新技术国家重点实验室南京 210093)

基金项目:

国家自然科学基金(U1301257, 61171163, 61271270, 61271021, 61311140262)，宁波市自然科学基金(2013A610113)

计量
- 文章访问数: 1555
- HTML全文浏览量: 174
- PDF下载量: 468
- 被引次数: 0
出版历程
- 收稿日期: 2015-03-04
- 修回日期: 2015-11-18
- 刊出日期: 2016-02-19

Objective Visual Comfort Assessment Model of Stereo Image Based on Scene Mode

2.
(Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, China)

Funds:

The National Natural Science Foundation of China (U1301257, 61171163, 61271270, 61271021, 61311140262), Natural Science Foundation of Ningbo (2013A610113)

摘要

摘要: 为了预测双目立体图像内容对视觉健康可能产生的危害，该文提出一种基于场景模式的立体图像舒适度客观评价模型。根据场景中前景目标和后景区域相对于显示屏幕的凹凸性以及是否处于舒适观看区，将自然场景抽象为多种场景模式。在模式选择阶段，从视差图中自适应分割出前景目标和后景区域，根据前、后景的视差角特征确定场景所属的模式；在建模阶段，采用前、后景的视差角特征结合前景的宽度角和曲折度特征对各个场景模式分别进行建模，并量化了前、后景视差因素对视觉舒适度的影响。在IVY数据库上的实验结果表明，所提出的模型与主观感知存在较好的一致性，Pearson相关系数高于0.91, Spearman相关系数高于0.90, Kendall相关系数高于0.74，平均绝对值误差低于0.24，均方根误差低于0.32，与现有的方法相比，该文所提出的模型的评价效果更好，更接近于主观测试结果。
- 立体图像 /
- 舒适度评价 /
- 场景模式 /
- 双目视觉
Abstract: To predict the effects induced by stereo image content on visual health, a new objective Visual Comfort Assessment (VCA) method of stereo image is proposed based on scene modes. Natural scene is abstracted as multiple scene modes according to two position states of foreground object and background region. One is the convex-concave to screen, and the other is the whether locate on zone of comfortable viewing. In the process of mode selection, disparity map is utilized to segment scene into foreground object and background region adaptively. Then, the scenes mode can be determined by disparity angle features of both foreground object and background region. In the modeling stage, disparity angle features of foreground object and background region, width angle and sinuosity features of foreground object are utilized to build objective VCA models in various scene modes. The experimental results tested on IVY database show that high consistency exists between the proposed model and subjective perception that Pearson linear correlation coefficient is higher than 0.91, Spearman rank-order correlation coefficient is higher than 0.90, Kendall rank-order correlation coefficient is higher than 0.74, Mean Absolute Error (MAE) is lower than 0.24 and Root Mean Squared Error (RMSE) is lower than 0.32. Compared with other existing methods, the proposed model has the better assessment performance and is much closer to the subjective assessment scores.
- Stereo image /
- Visual comfort assessment /
- Scene mode /
- Binocular vision

HTML全文

参考文献(22)

HEWAGE C T E R and MARINI M G. Quality of experience for 3D video streaming[J]. IEEE Communications Magazine, 2013, 51(5): 101-107.

蒋骁辰, 李国平, 王国中, 等. 基于AVS+实时编码的多核并行视频编码算法[J]. 电子与信息学报, 2014, 36(4): 810-816. doi: 103724/SP.J.1146.2013.00845.

JIANG Xiaochen, LI Guoping, WANG Guozhong, et al. Multi-core parallel video coding algorithm based on AVS+ real-time encoding[J]. Journal of Electronics Information Technology, 2014, 36(4): 810-816. doi: 103724/SP.J.1146.2013. 00845.

KIM D and SOHN K. Visual fatigue prediction for stereoscopic image[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(2): 231-236.

LI J, BARKOWSKY M, and CALLET P L. Visual discomfort of stereoscopic 3D videos: Influence of 3D motion[J]. Displays, 2014, 35(1): 49-57.

UKAI K and HOWARTH P A. Visual fatigue caused by viewing stereoscopic motion images: Background, theories and observations[J]. Displays, 2008, 29(2): 106-116.

PARK J, LEE S, and BOVIK A C. 3D visual discomfort prediction: Vergence, foveation, and the physiological optics of accommodation[J]. IEEE Journal of Selected Topics in Signal Processing, 2014, 8(3): 415-427.

RICHARDS W and KAYE M G. Local versus global stereopsis: two mechanisms[J]. Visual Research, 1974, 14(12): 1345-1347.

LEE S, JUNG Y J, SOHN H, et al. Effect of stimulus width on the perceived visual discomfort in viewing stereoscopic 3-D-TV[J]. IEEE Transactions on Broadcasting, 2013, 59(4): 580-590.

SCHOR C, WOOD I, and OGAWA J. Binocular sensory fusion is limited by spatial resolution[J]. Visual Research, 1984, 24(7): 661-665.

SCHOR C, HECKMANN T, and TYLER C W. Binocular fusion limits are independent of contrast, luminance gradient and component phases[J]. Visual Research, 1989, 29(7): 821-835.

WOPKING M. Viewing comfort with stereoscopic pictures: an experimental study on the subjective effects of disparity magnitude and depth of focus[J]. Journal of the Society for Information Display, 1995, 3(3): 101-103.

王勤, 王琼华, 刘春玲. 视差与空间频率对自由立体显示器观看舒适度的影响[J]. 光电子激光, 2012, 23(8): 1604-1608.

WANG Qin, WANG Qionghua, and LIU Chunling. Effects of parallax and spatial frequency on visual comfort in autostereoscopic display[J]. Journal of Optoelectronics Laser, 2012, 23(8): 1604-1608.

SOHN H, JUNG Y J, LEE S, et al. Predicting visual discomfort using object size and disparity information in stereoscopic images[J]. IEEE Transactions on Broadcasting, 2013, 59(1): 28-37.

姜求平, 邵枫, 蒋刚毅, 等. 基于视觉重要区域的立体图像视觉舒适度客观评价方法[J]. 电子与信息学报, 2014, 36(4): 875-881. doi: 103724/SP.J.1146.2013.00946.

JIANG Qiuping, SHAO Feng, JIANG Gangyi, et al. An objective stereoscopic image visual comfort assessment metric based on visual important regions[J]. Journal of Electronics Information Technology, 2014, 36(4): 875-881. doi: 103724/SP.J.1146.2013.00946.

KIM H, LEE S, and BOVIK A C. Saliency prediction on stereoscopic videos[J]. IEEE Transactions on Image Processing, 2014, 23(4): 1476-1490.

LAMBOOIJ M, IJSSELSTEIJN W, FORTUIN M, et al. Visual discomfort and visual fatigue of stereoscopic displays: a review[J]. Journal of Imaging Science and Technology, 2009, 53(4): 030201.

HOLLIMAN N. 3D Display Systems[M]. London: UK, IOP Press, 2004: 7-8.

ISO/IEC JTC1/SC29/WG11 M16923. Depth Estimation Reference Software (DERS) 5.0[R]. Xian, China, 2009.

WILCOX L M and HESS R F. Dmax for stereopsis depends on size, not spatial frequency content[J]. Visual Research, 1995, 35(9): 1061-1069.

施引文献

资源附件(0)

访问统计