Seyed Mojtaba ZADEH MARVASTI, Hossein YAKHDAN GHANEI

Video temporal error concealment using improved directional boundary matching algorithm

Nowadays some systems such as multimedia systems try to present a high quality of digital videos every day. Because of the possible errors in communication channels, compressed video data would be damaged in the sending process. Error concealment is a useful technique for concealing the effects of sending errors at the decoder. In this paper, an improved directional boundary matching algorithm is presented, in which by using adjacent macroblocks (MBs) of the damaged MB a direction is identified for each boundary. Then every boundary of candidate MBs is compared to an identified direction. Finally, the candidate motion vector (MV) that has the minimum improved directional matching function is selected as the MV of the damaged MB. Furthermore, to increase the accuracy in damaged MV estimation, a specific weight is given to the boundaries of adjacent MBs. Conforming to the experimental results, the proposed algorithm not only outperforms subjective visual evaluation compared to classic boundary matching, outer boundary matching, and directional boundary matching algorithms, but also it is able to improve the objective quality of reconstructed video frames effectively.

PDF

___

[1] Aign S, Fazel K. Temporal and spatial error concealment techniques for hierarchical MPEG-2 video codec. In: IEEE 1995 International Conference on Communications; 1822 June 1995; Seattle, WA, USA. New York, NY, USA: IEEE. pp. 1778-1783.
[2] Jung Y, Kim Y, Choe Y. Robust error concealment algorithm using iterative weighted boundary matching criterion. In: 2000 International Conference on Image Processing; 1013 September 2000; Vancouver, BC, Canada. New York, NY, USA: IEEE. pp. 384-387.
[3] Yan B, Ng K. A novel selective motion vector matching algorithm for error concealment in MPEG-4 video transmission over error-prone channels. IEEE T Consum Electr 2003; 49: 1416-1423.
[4] Lee Y, Altunbasak Y, Mersereau R. A temporal error concealment method for MPEG coded video using a multiframe boundary matching algorithm. In: 2001 International Conference on Image Processing; 710 October 2001; Thessaloniki, Greece. New York, NY, USA: IEEE. pp. 990-993.
[5] Min C, Jin S, Oh H, Park S, Jeong J. Temporal error concealment algorithm for H.264/AVC using omnidirectional motion similarity. In: 2010 International Conference on Image Processing Theory Tools and Applications; 710 July 2010; Paris, France. New York, NY, USA: IEEE. pp. 144-148.
[6] Park J, Kim J, Lee S. DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error. IEEE T Circ Syst Vid 1997; 7: 845-854.
[7] Alkachouh Z, Bellanger M. Fast DCT-based spatial domain interpolation of blocks in images. IEEE T Image Process 2000; 9: 729-732.
[8] Kang LW, Leou JJ. A hybrid error concealment scheme for MPEG-2 video transmission based on best neighborhood matching algorithm. In: IEEE 2004 International Conference on Multimedia and Expo; 2730 June 2004; Taipei, Taiwan. New York, NY, USA: IEEE. pp. 1355-1358.
[9] Jo M, Kim H, Song W. Hybrid error concealments based on block content. IET Image Process 2007; 1: 141-148.
[10] Ma X, Mu K. Study on the adaptive error concealment technique for mobile video. In: IEEE 2011 International Conference on Communication Software and Networks; 2729 May 2011; Xian, China. New York, NY, USA: IEEE. pp. 276-279.
[11] Haskell P, Messerschmitt D. Resynchronization of motion compensated video affected by ATM cell loss. In: IEEE 1992 International Conference on Acoustics, Speech, and Signal Processing; 2326 March 1992; San Francisco, CA, USA. New York, NY, USA: IEEE. pp. 545548.
[12] Chien J, Li G, Chen M. Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement. IEEE T Consum Electr 2010; 56: 1689-1698.
[13] Vazquez M, Garcia-Ramirez A, Ramirez-Acosta A. Image processing for error concealment. In: 2011 Mexican International Conference on Artificial Intelligence; 26 November4 December 2011; Puebla, Mexico. New York, NY, USA: IEEE. pp. 133-138.
[14] Lam W, Reibman A, Liu R. Recovery of lost or erroneously received motion vectors. In: IEEE 1993 International Conference on Acoustics, Speech, and Signal Processing; 2730 April 1993; Minneapolis, MN, USA. New York, NY, USA: IEEE. pp. 417-420.
[15] Ai M, Jiang Q. Weighted motion vectors of double candidate blocks based temporal error concealment method for video transmission over wireless network. In: 2010 International Conference on Educational and Network Technology; 2527 June 2010; Qinhuangdao, China. New York, NY, USA: IEEE. pp. 478-481.
[16] Araghi A, Agahian Panahi M, Kasaei S. Error concealment using wide motion vector space for H.264-AVC. In: 2011 Iranian Conference on Electrical Engineering; 1719 May 2011; Tehran, Iran. New York, NY, USA: IEEE. pp. 1-6.
[17] Gao Z, Lie W. Video Error Concealment by Using Kalman-Filtering Technique. In: 2004 International Symposium on Circuits and Systems; 2326 May 2004; Vancouver, BC, Canada. New York, NY, USA: IEEE. pp. 69-72.
[18] Marvasti-Zadeh SM, Ghanei-Yakhdan H, Kasaei S. A novel boundary matching algorithm for video temporal error concealment. International Journal of Image, Graphics, and Signal Processing 2014; 6: 1-10.
[19] Thaipanich T, Wu P, Jay Kuo C. Video error concealment with outer and inner boundary matching algorithms. International Society for Optical Engineering Journal 2007; 6696: 6696-07.
[20] Marvasti-Zadeh SM, Ghanei-Yakhdan H, Kasaei S. Dynamic temporal error concealment for video data in errorprone environments. In: 2013 Iranian Conference on Machine Vision and Image Processing; 1012 September 2013; Zanjan, Iran. New York, NY, USA: IEEE. pp. 43-47.
[21] Nemethova O, Al-Moghrabi A, Rupp M. An adaptive error concealment mechanism for H.264/AVC encoded lowresolution video streaming. In: 2006 European Signal Processing Conference; 46 September 2006; Florence, Italy.
[22] Marvasti-Zadeh SM, Ghanei-Yakhdan H, Kasaei S. An efficient adaptive boundary matching algorithm for video error concealment. Iranian Journal of Electrical & Electronic Engineering 2014; 10: 188-202.
[23] Xiang Y, Feng L, Xie S, Zhou Z. An efficient spatio-temporal boundary matching algorithm for video error concealment. Multimed Tools Appl 2011; 52: 91-103.
[24] Chen X, Chung Y, Bae C. Dynamic multi-mode switching error concealment algorithm for H.264/AVC video applications. IEEE T Consum Electr 2008; 54: 683-695.
[25] Wang Y, Zhu Q. Error control and concealment for video communication: a review. P IEEE 1998; 86: 974-997.
[26] Barjatya A. Block matching algorithms for motion estimation. Final Project Paper, DIP 6620, Spring 2004. Logan, UT, USA: Utah State University, 2004.