Scalable Video Coding

{{Infobox file format

| name = Scalable Video Coding (SVC)

| standard = H.264/MPEG-4 AVC Amendment

}}

Scalable Video Coding (SVC) is a video compression standard developed jointly by the ITU-T and the ISO/IEC. The two organizations formed the Joint Video Team (JVT) to create the H.264/MPEG-4 AVC standard (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC). SVC aims to provide adaptable or scalable content, allowing a single encoded video stream to be decoded at various bitrates, resolutions, and quality levels, thus catering to diverse devices and network conditions.{{cite web |last=Oliver |first=Mark |date=March 10, 2008 |title=Tutorial: The H.264 Scalable Video Codec (SVC) |trans-title= |url=https://www.edn.com/tutorial-the-h-264-scalable-video-codec-svc/ |access-date=October 6, 2023 |website=EDN}}

History

In October 2003, the Moving Picture Experts Group (MPEG) issued a Call for Proposals on SVC Technology. Fourteen proposals were submitted, twelve of which utilized wavelet compression, while the remaining two were extensions of H.264/MPEG-4 AVC. The proposal from the Heinrich-Hertz-Institut (HHI) was selected by MPEG as the foundation for the SVC standardization project.{{cite web |last1=Schwarz |first1=Heiko |last2=Wiegand |first2=Thomas |date=December 14, 2004 |title=Image Communication: The Scalable Video Coding Amendment of the H.264/AVC Standard |trans-title= |url=http://ip.hhi.de/imagecom_G1/savce/index.htm |archive-url=https://web.archive.org/web/20110725091226/http://ip.hhi.de/imagecom_G1/savce/index.htm |archive-date=July 25, 2011 |access-date=October 8, 2023 |website=HHI}}

In January 2005, MPEG and the Video Coding Experts Group (VCEG) agreed to finalize SVC as an amendment to the H.264/MPEG-4 AVC standard.

In November 2008, Google launched Gmail Video Chat, which employed an H.264/SVC codec, marking the first consumer application of the standard.{{cite web |last=Leguilloux |first=Claude |date=January 8, 2009 |title=Proservia: News from Ovialis |trans-title= |url=https://www.boursier.com/actions/actualites/news/proservia-des-nouvelles-d-ovialis-314673.html |access-date=October 8, 2023 |website=boursier.com}}{{cite web |date=November 12, 2008 |title=Google Launches Gmail Video Chat |trans-title= |url=https://journalmetro.com/societe/techno/44912/google-lance-gmail-video-chat/ |access-date=October 8, 2023 |website=Métro}}{{cite web |last=Trapani |first=Gina |date=November 11, 2008 |title=Google Launches Voice and Video Chat Inside Gmail |trans-title= |url=https://lifehacker.com/google-launches-voice-and-video-chat-inside-gmail-5083481 |archive-url=https://web.archive.org/web/20200810164921/https://lifehacker.com/google-launches-voice-and-video-chat-inside-gmail-5083481 |archive-date=August 10, 2020 |access-date=October 8, 2023 |website=Lifehacker}} This service was succeeded by Google+ Hangouts in 2012.{{cite web |last=Libo-on |first=Aki |date=August 1, 2012 |title=Google Replaces Gmail Video Chat with Google+ Hangouts |trans-title= |url=https://www.searchenginejournal.com/google-replaces-gmail-video-chat-with-google-hangouts/56280/ |archive-url=https://web.archive.org/web/20151002053316/https://www.searchenginejournal.com/google-replaces-gmail-video-chat-with-google-hangouts/56280/ |archive-date=October 2, 2015 |access-date=October 8, 2023 |website=searchenginejournal.com}}

In 2011, Google Code highlighted SVC as the successor to the open-source RVC video chat engine, noting its prominence in 2010.{{cite web |date=August 30, 2008 |title=Open source version of the SVC video call engine |trans-title= |url=https://code.google.com/archive/p/video-call/ |access-date=October 8, 2023 |website=Google Code}}

Principles of scalability

= Overview =

Scalability refers to the ability to represent a video signal at multiple levels of detail within a single encoded bitstream. This enables decoding of a base layer for basic quality and additional enhancement layers for progressively higher quality.

SVC defines three types of scalability:{{cite web |last1=Shahid |first1=Zafar |last2=Chaumont |first2=Marc |last3=Puech |first3=William |title=Scalable Video Coding |trans-title= |url=https://www.lirmm.fr/~wpuech/recherche/publications/Book/11_Scalable-video-coding.pdf#page=3 |archive-url=https://web.archive.org/web/20170829133328/https://www.lirmm.fr/~wpuech/recherche/publications/Book/11_Scalable-video-coding.pdf#page=3 |archive-date=August 29, 2017 |access-date=October 6, 2023 |website=LIRMM |page=3 |format=PDF}}

Spatial scalability: Supports multiple resolution levels.
Temporal scalability: Enables varying frame rates.
Quality scalability: Provides different image quality levels.

= Spatial scalability =

Spatial scalability allows the reconstruction of video at different resolutions, such as QCIF, CIF, or SD. This is achieved through a pyramidal decomposition into multiple spatial layers.

= Temporal scalability =

Temporal scalability adjusts the frame rate of the decoded video stream. Various frame rates are supported using a hierarchical structure of video frames.

= Quality scalability =

Quality scalability, or Signal-to-Noise Ratio (SNR) scalability, improves the signal-to-noise ratio of a layer, reducing quantization distortion between the original and reconstructed images. SVC supports two approaches: Fine Grain Scalability (FGS) and Coarse Grain Scalability (CGS).

== Coarse Grain Scalability (CGS) ==

CGS incorporates quality scalability across spatial resolutions. Each spatial resolution is encoded as a separate layer, refining texture and motion data. For a given resolution, quality scalability is achieved by encoding multiple quality layers with progressively finer quantization steps, starting from a base layer with minimal quality.

== Fine Grain Scalability (FGS) ==

FGS enables progressive refinement of transformed coefficients within a single spatial layer. The base quality layer is encoded using the AVC standard with an initial quantization parameter (QP) ensuring minimal acceptable quality. Subsequent refinement layers reduce the QP by six, halving the quantization step. The refinement data stream can be truncated at any point, allowing fine-grained quality scalability.

References

Bibliography

{{cite conference |last1=Mrak |first1=Marta |last2=Grgic |first2=Mislav |last3=Grgic |first3=Sonja |title=Scalable video coding in network applications |trans-title= |conference=VIPromCom-2002 |publisher=Faculty of Electrical Engineering and Computing, University of Zagreb |date=June 16, 2002 |location=Zadar, Croatia |url=https://www.vcl.fer.hr/papers_pdf/Scalable%20video%20coding%20in%20network%20applications.pdf |access-date=October 8, 2023 }}
{{cite journal |last=Ohm |first=Jens-Rainer |title=Advances in Scalable Video Coding |trans-title= |journal=Proceedings of the IEEE |volume=93 |issue=1 |date=January 1, 2015 |publisher=IEEE |location=New York |issn=1558-2256 |url=http://www.csee.wvu.edu:80/~xinl/courses/ee591f/scalable_coding_review.pdf |access-date=October 8, 2023 |archive-url=https://web.archive.org/web/20050505170728/http://www.csee.wvu.edu:80/~xinl/courses/ee591f/scalable_coding_review.pdf |archive-date=May 5, 2005}}
{{cite journal |last1=Schwarz |first1=Heiko |last2=Marpe |first2=Detlev |last3=Wiegand |first3=Thomas |title=Overview of the Scalable Video Coding Extension of the H.264/AVC Standard |trans-title= |journal=IEEE Transactions on Circuits and Systems for Video Technology |volume=17 |issue=9 |date=2007 |pages=1103–1120 |publisher=Institute of Electrical and Electronics Engineers |location=New York |doi=10.1109/TCSVT.2007.905532 |issn=1558-2205 |url=http://ip.hhi.de/imagecom_G1/assets/pdfs/Overview_SVC_IEEE07.pdf |access-date=October 8, 2023 |archive-url=https://web.archive.org/web/20110725091248/http://ip.hhi.de/imagecom_G1/assets/pdfs/Overview_SVC_IEEE07.pdf |archive-date=July 25, 2011}}
{{cite journal |last1=Wien |first1=Mathias |last2=Schwarz |first2=Heiko |last3=Oelbaum |first3=Tobias |title=Performance Analysis of SVC |trans-title= |journal=IEEE Transactions on Circuits and Systems for Video Technology |volume=17 |issue=9 |date=2007 |publisher=IEEE |location=New York |issn=1558-2205 |url=http://ip.hhi.de/imagecom_G1/assets/pdfs/PerformanceAnalysis_SVC_IEEE07.pdf |access-date=October 8, 2023 |archive-url=https://web.archive.org/web/20110818160015/http://ip.hhi.de/imagecom_G1/assets/pdfs/PerformanceAnalysis_SVC_IEEE07.pdf |archive-date=August 18, 2011}}
{{cite journal |last1=Wenger |first1=Stephan |last2=Wang |first2=Ye-Kui |last3=Schierl |first3=Thomas |title=Transport and Signaling of SVC in IP Networks |trans-title= |journal=IEEE Transactions on Circuits and Systems for Video Technology |volume=17 |issue=9 |date=2007 |pages=1164–1173 |publisher=IEEE |location=New York |doi=10.1109/TCSVT.2007.905523 |issn=1558-2205 |url=http://ip.hhi.de/imagecom_G1/assets/pdfs/Transport_Signaling_SVC_IEEE07.pdf |access-date=October 8, 2023 |archive-url=https://web.archive.org/web/20111001070513/http://ip.hhi.de/imagecom_G1/assets/pdfs/Transport_Signaling_SVC_IEEE07.pdf |archive-date=October 1, 2011}}
{{cite journal |last1=Schierl |first1=Thomas |last2=Stockhammer |first2=Thomas |last3=Wiegand |first3=Thomas |title=Mobile Video Transmission Using Scalable Video Coding |trans-title= |journal=IEEE Transactions on Circuits and Systems for Video Technology |volume=17 |issue=9 |date=2007 |pages=1204–1217 |publisher=IEEE |location=New York |doi=10.1109/TCSVT.2007.905528 |issn=1558-2205 |url=http://ip.hhi.de/imagecom_G1/assets/pdfs/Mobile_Transmission_SVC_IEEE07.pdf |access-date=October 8, 2023 |archive-url=https://web.archive.org/web/20110818155550/http://ip.hhi.de/imagecom_G1/assets/pdfs/Mobile_Transmission_SVC_IEEE07.pdf |archive-date=August 18, 2011}}
{{cite journal |last1=Schwarz |first1=Heiko |last2=Wien |first2=Mathias |title=The Scalable Video Coding Extension of the H.264/AVC Standard |trans-title= |journal=IEEE Signal Processing Magazine |issue=135 |date=2008 |publisher=IEEE |location=New York |doi=10.1109/MSP.2007.914712 |issn=1558-0792 |url=http://ip.hhi.de/imagecom_G1/savce/downloads/2008_SP_Schwarz-Wien_SVCInANutshell.pdf |access-date=October 8, 2023 |archive-url=https://web.archive.org/web/20111001070348/http://ip.hhi.de/imagecom_G1/savce/downloads/2008_SP_Schwarz-Wien_SVCInANutshell.pdf |archive-date=October 1, 2011}}
{{cite journal |last1=Wiegand |first1=Thomas |last2=Noblet |first2=Ludovic |last3=Rovati |first3=Fabrizio |title=Scalable Video Coding for IPTV Services |trans-title= |journal=IEEE Transactions on Broadcasting |date=February 16, 2009 |volume=55 |issue=2 |pages=527–538 |publisher=IEEE |location=New York |doi=10.1109/TBC.2009.2020954 |issn=1557-9611 |url=https://www.st.com/content/ccc/resource/sales_and_marketing/promotional_material/magazine/5d/df/49/19/f4/89/43/91/TP%201037%20IEEE%20T%20Broadcasting%20(2).pdf/files/TP%201037%20IEEE%20T%20Broadcasting%20(2).pdf/jcr:content/translations/en.TP%201037%20IEEE%20T%20Broadcasting%20(2).pdf |access-date=October 8, 2023 }}
{{cite web |last1=Urteaga |first1=Iñigo |last2=Del Ser |first2=Javier |last3=Roesler |first3=Valter |display-authors=etal |title=A Tutorial on H.264/SVC Scalable Video Coding and its Tradeoff between Quality, Coding Efficiency and Performance |trans-title= |url=https://www.researchgate.net/publication/221912993 |date=June 26, 2011 |website=ResearchGate |publisher=Intech |access-date=October 8, 2023 |format=PDF}}