Advanced Search
Volume 38 Issue 2
Feb.  2016
Turn off MathJax
Article Contents
YING Hongwei, JIANG Gangyi, YU Mei, PENG Zongju, SHAO Feng. Objective Visual Comfort Assessment Model of Stereo Image Based on Scene Mode[J]. Journal of Electronics & Information Technology, 2016, 38(2): 294-302. doi: 10.11999/JEIT150267
Citation: YING Hongwei, JIANG Gangyi, YU Mei, PENG Zongju, SHAO Feng. Objective Visual Comfort Assessment Model of Stereo Image Based on Scene Mode[J]. Journal of Electronics & Information Technology, 2016, 38(2): 294-302. doi: 10.11999/JEIT150267

Objective Visual Comfort Assessment Model of Stereo Image Based on Scene Mode

doi: 10.11999/JEIT150267
Funds:

The National Natural Science Foundation of China (U1301257, 61171163, 61271270, 61271021, 61311140262), Natural Science Foundation of Ningbo (2013A610113)

  • Received Date: 2015-03-04
  • Rev Recd Date: 2015-11-18
  • Publish Date: 2016-02-19
  • To predict the effects induced by stereo image content on visual health, a new objective Visual Comfort Assessment (VCA) method of stereo image is proposed based on scene modes. Natural scene is abstracted as multiple scene modes according to two position states of foreground object and background region. One is the convex-concave to screen, and the other is the whether locate on zone of comfortable viewing. In the process of mode selection, disparity map is utilized to segment scene into foreground object and background region adaptively. Then, the scenes mode can be determined by disparity angle features of both foreground object and background region. In the modeling stage, disparity angle features of foreground object and background region, width angle and sinuosity features of foreground object are utilized to build objective VCA models in various scene modes. The experimental results tested on IVY database show that high consistency exists between the proposed model and subjective perception that Pearson linear correlation coefficient is higher than 0.91, Spearman rank-order correlation coefficient is higher than 0.90, Kendall rank-order correlation coefficient is higher than 0.74, Mean Absolute Error (MAE) is lower than 0.24 and Root Mean Squared Error (RMSE) is lower than 0.32. Compared with other existing methods, the proposed model has the better assessment performance and is much closer to the subjective assessment scores.
  • loading
  • HEWAGE C T E R and MARINI M G. Quality of experience for 3D video streaming[J]. IEEE Communications Magazine, 2013, 51(5): 101-107.
    蒋骁辰, 李国平, 王国中, 等. 基于AVS+实时编码的多核并行视频编码算法[J]. 电子与信息学报, 2014, 36(4): 810-816. doi: 103724/SP.J.1146.2013.00845.
    JIANG Xiaochen, LI Guoping, WANG Guozhong, et al. Multi-core parallel video coding algorithm based on AVS+ real-time encoding[J]. Journal of Electronics Information Technology, 2014, 36(4): 810-816. doi: 103724/SP.J.1146.2013. 00845.
    KIM D and SOHN K. Visual fatigue prediction for stereoscopic image[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(2): 231-236.
    LI J, BARKOWSKY M, and CALLET P L. Visual discomfort of stereoscopic 3D videos: Influence of 3D motion[J]. Displays, 2014, 35(1): 49-57.
    UKAI K and HOWARTH P A. Visual fatigue caused by viewing stereoscopic motion images: Background, theories and observations[J]. Displays, 2008, 29(2): 106-116.
    PARK J, LEE S, and BOVIK A C. 3D visual discomfort prediction: Vergence, foveation, and the physiological optics of accommodation[J]. IEEE Journal of Selected Topics in Signal Processing, 2014, 8(3): 415-427.
    RICHARDS W and KAYE M G. Local versus global stereopsis: two mechanisms[J]. Visual Research, 1974, 14(12): 1345-1347.
    LEE S, JUNG Y J, SOHN H, et al. Effect of stimulus width on the perceived visual discomfort in viewing stereoscopic 3-D-TV[J]. IEEE Transactions on Broadcasting, 2013, 59(4): 580-590.
    SCHOR C, WOOD I, and OGAWA J. Binocular sensory fusion is limited by spatial resolution[J]. Visual Research, 1984, 24(7): 661-665.
    SCHOR C, HECKMANN T, and TYLER C W. Binocular fusion limits are independent of contrast, luminance gradient and component phases[J]. Visual Research, 1989, 29(7): 821-835.
    WOPKING M. Viewing comfort with stereoscopic pictures: an experimental study on the subjective effects of disparity magnitude and depth of focus[J]. Journal of the Society for Information Display, 1995, 3(3): 101-103.
    王勤, 王琼华, 刘春玲. 视差与空间频率对自由立体显示器观看舒适度的影响[J]. 光电子 激光, 2012, 23(8): 1604-1608.
    WANG Qin, WANG Qionghua, and LIU Chunling. Effects of parallax and spatial frequency on visual comfort in autostereoscopic display[J]. Journal of Optoelectronics Laser, 2012, 23(8): 1604-1608.
    SOHN H, JUNG Y J, LEE S, et al. Predicting visual discomfort using object size and disparity information in stereoscopic images[J]. IEEE Transactions on Broadcasting, 2013, 59(1): 28-37.
    姜求平, 邵枫, 蒋刚毅, 等. 基于视觉重要区域的立体图像视觉舒适度客观评价方法[J]. 电子与信息学报, 2014, 36(4): 875-881. doi: 103724/SP.J.1146.2013.00946.
    JIANG Qiuping, SHAO Feng, JIANG Gangyi, et al. An objective stereoscopic image visual comfort assessment metric based on visual important regions[J]. Journal of Electronics Information Technology, 2014, 36(4): 875-881. doi: 103724/SP.J.1146.2013.00946.
    KIM H, LEE S, and BOVIK A C. Saliency prediction on stereoscopic videos[J]. IEEE Transactions on Image Processing, 2014, 23(4): 1476-1490.
    LAMBOOIJ M, IJSSELSTEIJN W, FORTUIN M, et al. Visual discomfort and visual fatigue of stereoscopic displays: a review[J]. Journal of Imaging Science and Technology, 2009, 53(4): 030201.
    HOLLIMAN N. 3D Display Systems[M]. London: UK, IOP Press, 2004: 7-8.
    ISO/IEC JTC1/SC29/WG11 M16923. Depth Estimation Reference Software (DERS) 5.0[R]. Xian, China, 2009.
    WILCOX L M and HESS R F. Dmax for stereopsis depends on size, not spatial frequency content[J]. Visual Research, 1995, 35(9): 1061-1069.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (1542) PDF downloads(467) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return