Nükhet ÖZBEK, Gizem ERTAN, Oktay KARAKUŞ

Perceptual quality evaluation of asymmetric stereo video coding for efficient 3D rate scaling

In 3D perception, the binocular suppression of the human vision, perceiving high quality 3D video in the case of a view in higher quality, can be exploited in asymmetric stereo video coding for efficient 3D rate scaling. Hence, the best stereo rate-visual distortion performance may be gained by asymmetric coding, which is the reduction of the spatial and/or quantization resolution of the low-quality view, while keeping the high-quality view in full resolution. However, how to determine the level of asymmetry and what type of scaling should be chosen are still in question. In this work, we try to assess the overall performance of the scalability options with several test contents. The test videos are encoded at critical bitrates with symmetric options and spatial or signal-to-noise ratio (SNR) asymmetric coding, and are subjectively evaluated in a stereo-polarized projection 3D display system. Two different types of evaluation methodologies are used: the Double-Stimulus Continuous-Quality Scale (DSCQS) and Subjective Evaluation of Stereo Video Quality (SESVIQ). Dense visual tests show that the spatial scaling is generally inferior when compared to SNR scaling, except that high motion scenes and symmetric SNR are more preferable for a higher bitrate. The characteristics of the video content should be taken into consideration for efficient stereo rate scaling.

Anahtar Kelimeler:

Asymmetric stereo video coding, 3D video quality assessment, DSCQS, SESVIQ, blur, blockiness

Perceptual quality evaluation of asymmetric stereo video coding for efficient 3D rate scaling

Keywords:

Asymmetric stereo video coding, 3D video quality assessment, DSCQS, SESVIQ, blur, blockiness,

PDF

___

K. M¨ uller, P. Merkle, H. Schwarz, T. Hinz, A. Smolic, T. Oelbaum, T. Wiegand, “Multi-view video coding based on H.264/MPEG4-AVC using hierarchical B pictures”, Proceedings of the International Picture Coding Symposium, 200 B. Julesz, Foundations of Cyclopean Perception, Chicago, IL, USA, University of Chicago Press, 1971.
L.B. Stelmach, W.J. Tam, “Stereoscopic image coding: effect of disparate image-quality in left-and right-eye views”, Signal Processing: Image Communication, Vol. 14, pp. 111–117, 1998.
L.B. Stelmach, W.J. Tam, D.V. Meegan, A. Vincent, P. Corriveau, “Human perception of mismatched stereoscopic 3D inputs”, Proceedings of the International Conference on Image Processing, Vol. 1, pp. 5–8, 2000.
L. Stelmach, W.J. Tam, D. Meegan, A. Vincent, “Stereo image quality: effects of mixed spatio-temporal resolution”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, pp. 188–193, 2000.
D. Meegan, L. Stelmach, W.J. Tam, “Unequal weighting of monocular inputs in binocular combination: implications for the compression of stereoscopic imagery”, Journal of Experimental Psychology: Applied, Vol. 7, pp. 143–153, 200 N. Ozbek, M. Tekalp, “Unequal inter-view rate allocation using scalable stereo video and an objective stereo video quality measure”, IEEE International Conference on Multimedia and Expo, pp. 1113–1116, 2008.
A. Aksay, C. Bilen, E. Kurutepe, T. Ozcelebi, G.B. Akar, M.R. Civanlar, A.M. Tekalp, “Temporal and spatial scaling for stereoscopic video compression”, Proceedings of the 14th European Signal Processing Conference, pp. 1–5, 2006.
A. Aksay, S. Pehlivan, E. Kurutepe, C. Bilen, T. Ozcelebi, G. Bozdagi Akar, M.R. Civanlar, A.M. Tekalp, “Endto-end stereoscopic video streaming with content-adaptive rate and format control”, Signal Processing: Image Communication, Vol. 22, pp. 157–168, 2007.
C. Fehn, P. Kauff, S. Cho, H. Kwon, N. Hur, J. Kim, “Asymmetric coding of stereoscopic video for transmission over T-DMB”, Proceedings of the 3DTV Conference, pp. 1–4, 2007.
P. Aflaki, M.M. Hannuksela, J. Hakkinen, P. Lindroos, M. Gabbouj, “Subjective study on compressed asymmetric stereoscopic video”, Proceedings of the 17th IEEE International Conference on Image Processing, pp. 4021–4024, 20
G. Saygılı, C.G. G¨ urler, A. M. Tekalp, “3D display dependent quality evaluation and rate allocation using scalable video coding”, Proceedings of the 16th IEEE International Conference on Image Processing, pp. 717–720, 2009. G. Saygılı, C.G. G¨ urler, A.M. Tekalp, “Quality assessment of asymmetric stereo video coding”, Proceedings of the 17th IEEE International Conference on Image Processing, pp. 4009–4012, 2010.
G. Saygılı, C.G. G¨ urler, A.M. Tekalp, “Evaluation of asymmetric stereo video coding and rate scaling for adaptive 3D video streaming”, IEEE Transactions on Broadcasting, Vol. 57, pp. 593–601, 2011.
S.F. Chang, A. Vetro, “Video adaptation: concepts, technologies, and open issues”, Proceedings of the IEEE, Vol. 93, pp. 148–158, 2005.
L.M.J. Meesters, W.A. IJsselsteijn, P.J.H. Seuntiens, “A survey of perceptual evaluations and requirements of three-dimensional TV”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 14, pp. 381–391, 200 P. Campisi, P. Le Callet, E. Marini, “Stereoscopic images quality assessment”, Proceedings of the 15th European Signal Processing Conference, 2007.
A. Boev, A. Gotchev, K. Egiazarian, A. Aksay, G.B. Akar, “Towards compound stereo-video quality metric: a specific encoder-based framework”, IEEE Southwest Symposium on Image Analysis and Interpretation, pp. 218– 222, 2006.
International Telecommunication Union, Rec. ITU-R BT.500-11, Methodology for the Subjective Assessment of the Quality of Television Pictures, Geneva, Switzerland, ITU, 2002.
International Telecommunication Union, Rec. ITU-T P.910, Subjective Video Quality Assessment Methods for Multimedia Applications, Geneva, Switzerland, ITU, 2000.
European Broadcasting Union, EBU-UER BNP 056, Technical Report, SAMVIQ – Subjective Assessment Methodology for Video Quality, Geneva, Switzerland, EBU, 2003.
J.L. Blin, “New quality evaluation method suited to multimedia context SAMVIQ”, International Workshop on Video Processing and Quality Metrics, 2006.
A. Smolic, G. Tech, H. Brust, “Report on generation of stereo video database”, Mobile3DTV Technical Report D1, 2010.
Joint Video Team of ITU-T VCEG and ISO/IEC MPEG, “Joint Scalable Video Model JSVM-4”, Joint Video Team, Doc. JVT-Q202, 2005.
V. Baroncini, “New tendencies in subjective video quality evaluation”, IEICE Transactions on Fundamentals of Electronics Communications, Vol. E89-A, pp. 2933–2937, 2006.
D.M. Rouse, R. Pepion, P.L. Callet, S.S. Hemami, “Tradeoffs in subjective testing methods for image and video quality assessment”, Human Vision and Electronic Imaging XV, Proceedings of the SPIE, Vol. 7527, pp. 75270F– 75270F-11, 2010.
N. ¨ Ozbek, G. Ertan, O. Karaku¸s, “Interactive quality assessment for asymmetric coding of 3D video”, 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2011.
N. ¨ Ozbek, “Trellis-based optimization of layer extraction for rate adaptation in real-time scalable stereo video coding”, Turkish Journal of Electrical Engineering & Computer Sciences, Vol. 20, pp. 557–567, 2012.