A Survey on the H.264/AVC Standard

H.264/AVC is a recently completed video compression standard jointly developed by ITU-T VCEG and ISO/IEC MPEG standards committees. The standard is becoming more popular as it promises much higher compression than that possible with earlier standards. The standard provides flexibilities in coding and organization of data which enable efficient error resilience. The increased coding efficiency offers new application areas and business opportunities. As might be expected, the increases in compression efficiency and flexibility come at the expense of increase in complexity, which is a fact that must be overcome. This paper provides an overview of the technical features of H.264 and summarizes the emerging studies related to new coding features of the standard.

A Survey on the H.264/AVC Standard

H.264/AVC is a recently completed video compression standard jointly developed by ITU-T VCEG and ISO/IEC MPEG standards committees. The standard is becoming more popular as it promises much higher compression than that possible with earlier standards. The standard provides flexibilities in coding and organization of data which enable efficient error resilience. The increased coding efficiency offers new application areas and business opportunities. As might be expected, the increases in compression efficiency and flexibility come at the expense of increase in complexity, which is a fact that must be overcome. This paper provides an overview of the technical features of H.264 and summarizes the emerging studies related to new coding features of the standard.

___

  • ITU-T and ISO/IEC JTC 1, “Generic coding of moving pictures and associated audio information – Part 2:
  • Video”, ISO/IEC 13818-2 (MPEG-2), 1994. [2] ISO/IEC JTC1/SC29, “Coding of Audio-Visual Objects”, ISO/IEC 14496-2, International Stan
  • dard:1999/Amd1:2000, 2000.
  • A. Puri, X. Chen, A. Luthra, “Video Coding Using the H.264/MPEG-4 AVC Compression Standard”, to be
  • published in Elsevier Science, Signal Processing: Image Communication, September 2004 issue.
  • ISO/IEC JTC 1, “Advanced video coding”, ISO/IEC FDIS 14496-10, International Standard, 2003.
  • M. Horowitz, A. Joch, F. Kossentini, A. Hallapuro, “H.264/AVC Baseline Profile Decoder Complexity Analysis”,
  • IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 704-716, 2003.
  • T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, “Overview of the H.264/AVC Video Coding
  • Standard”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 560-576, 2003.
  • I. E. G. Richardson, H.264 and MPEG-4 Video Compression, UK Wiley, 2003.
  • M. Flierl, T. Wiegand, B. Girod, “Multihypothesis Pictures for H.26L”, IEEE ICIP 2001, Greece, 2001.
  • M. Flierl, B. Girod, “Generalized B Pictures and the Draft H.264/AVC Video-Compression Standard”, IEEE
  • Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 587-597, 2003.
  • D. Marpe, H. Schwarz, T. Wiegand, “Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 620-636, 2003.
  • P. List, A. Joch, J. Lainema, G. Bjontegaard, M. Karczewicz, “Adaptive Deblocking Filter”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 614-619, 2003.
  • Z. Zhou, M.T. Sun, S. Hsu, “Fast Variable Block-size Motion Estimation Algorithms Based on Merge and Split Procedure for H.264/MPEG-4 AVC”, IEEE ISCAS 2004 Conference.
  • Z. Zhou, M.T. Sun, “Fast Macroblock Inter Mode Decision and Motion Estimation for H.264/MPEG-4 AVC”, IEEE ICIP 2004 Conference.
  • E. Akyol, A. M. Tekalp, M. R. Civanlar, “Motion-Compensated Temporal Filtering within the H.264/AVC Standard”, IEEE ICIP 2004 Conference.
  • A. Secker, D. Taubman, “Highly scalable video compression using a lifting-based 3D wavelet transform with deformable mesh motion compensation”, IEEE ICIP 2002, pp. 749-752, 2002.
  • M. Flierl, B. Girod, “Investigation of motion compensated lifted wavelet transforms”, IEEE ICIP 2001, pp. 1029-1032, 2001.
  • L. Luo, J. Li, S. Li, Z. Zhuang, Y. Zhang, “Motion compensated lifting wavelet and its application in video coding”, ICME 2001, pp. 481-484, 2001.
  • P. Chen, J. W. Woods, “Improved MC-EZBC with quarter-pixel motion vectors”, ISO/IEC JTC1/SC29/WG11, MPEG2002/m8366, 2002.
  • J. Xu, R. Xiong, B. Feng, G. Sullivan, M. Lee, F. Wu, S. Li, “3D Sub-band Video Coding using Barbell lifting”, ISO/IEC JTC/WG11 M10569.
  • M. Karczewicz, R. Kurceren, “The SP- and SI-Frames Design for H.264/AVC”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 637-644, 2003.
  • X. Sun, F. Wu, S. Li, W. Gao, Y.Q. Zhang, “Improved SP coding techique”, JVT-B097, Joint Video Team of ISO/IEC MPEG & ITU-T VCEG, Geneva, 2002.
  • X. Sun, S. Li, F. Wu, J. Shen, W. Gao, “The Improved SP Frame Coding Technique for the JVT Standard”, IEEE ICIP 2003.
  • S. Wenger, “H.264/AVC Over IP”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 645-656, 2003.
  • T. Stockhammer, M. M. Hannuksela, T. Wiegand, “H.264/AVC in Wireless Environments”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 657-673, 2003.
  • T. Stockhammer, T. Wiegand, T. Oelbaum, F. Obermeier, “Video Coding and Transport Layer Techniques for H.264/AVC-Based Transmission over Packet-Lossy Networks”, IEEE ICIP 2003, Spain, 2003.
  • S. Wenger, T. Stockhammer, M. Hannuksela, “RTP payload Format for JVT Video”, draft-ietf-avt-rtp-h264- 00.txt, Internet Draft, 2002.
  • S. Wenger, M. Horowitz, “Flexible MB Ordering – A new Error Resilience Tool for IP-Based Video”, IWDC 2002 Conference, Italy, 2002.
  • E. Masala, C. F. Chiasserini, M. Meo, J. C. De Martin, “Real-Time Transmission of H.264 Video over 802.11- Based Wireless Ad Hoc Networks”, Proceedings of Workshop on DSP in Mobile and Vehicular Systems, Japan, 2003.
  • J. R. Corbera, P. A. Chou, S. L. Regunathan, “A Generalized Hypothetical Reference Decoder for H.264/AVC”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, no. 7, pp. 674-687, 2003.
  • S. Ma, W. Gao, F. Wu, Y. Lu, “Rate Control for JVT Video Coding Scheme with HRD Considerations”, IEEE International Conference on Image Processing (ICIP), Vol. 3, pp. 793-796, Spain, 2003.
  • T. ¨Oz¸celebi, A. M. Tekalp, M. R. Civanlar, “Optimal Rate and Input Format Control for Content and Context Adaptive Video Streaming”, IEEE ICIP 2004 Conference.