High dynamic range#Storage

{{Short description|Enhanced signal representation in images, videos, audio or radio}}

High dynamic range (HDR), also known as wide dynamic range, extended dynamic range, or expanded dynamic range, is a signal with a higher dynamic range than usual.

The term is often used in discussing the dynamic ranges of images, videos, audio or radio. It may also apply to the means of recording, processing, and reproducing such signals including analog and digitized signals.{{cite journal|last1=Robertson|first1=Mark A.|last2=Borman|first2=Sean|last3=Stevenson|first3=Robert L.|date=April 2003|title=Estimation-theoretic approach to dynamic range enhancement using multiple exposures|journal=Journal of Electronic Imaging|volume=12|issue=2|page=220, right column, line 26219–228|doi=10.1117/1.1557695|bibcode=2003JEI....12..219R|quote=The first report of digitally combining multiple pictures of the same scene to improve dynamic range appears to be Mann}}

Imaging

In this context, the term high dynamic range means there is a large amount of variation in light levels within a scene or an image. The dynamic range refers to the range of luminosity between the brightest area and the darkest area of that scene or image.

{{vanchor|High-dynamic-range imaging|text=High dynamic range imaging}} (HDRI) refers to the set of imaging technologies and techniques that allow the dynamic range of images or videos to be increased. It covers the acquisition, creation, storage, distribution and display of images and videos.{{Cite book|first1=Frédéric |last1=Dufaux |first2=Patrick |last2=Le Callet |first3=Rafal |last3=Mantiuk |first4=Marta |last4=Mrak|url=https://www.sciencedirect.com/book/9780081004128/high-dynamic-range-video|title=High Dynamic Range Video – From Acquisition to Display and Applications|year=2016|publisher=Elsevier |isbn=978-0-08-100412-8|doi=10.1016/C2014-0-03232-7}}

Modern films have often been shot with cameras featuring a higher dynamic range, and legacy films can be post-converted even if manual intervention will be needed for some frames (as when black-and-white films are converted to color).{{Citation needed|date=December 2016}} Also, special effects, especially those that mix real and synthetic footage, require both HDR shooting and rendering.{{Citation needed|date=December 2016}} HDR video is also needed in applications that demand high accuracy for capturing temporal aspects of changes in the scene. This is important in monitoring of some industrial processes such as welding, in predictive driver assistance systems in automotive industry, in surveillance video systems, and other applications.

= Capture =

{{Main|Multi-exposure HDR capture}}

In photography and videography, a technique, commonly named high dynamic range (HDR) allows the dynamic range of photos and videos to be captured beyond the native capability of the camera. It consists of capturing multiple frames of the same scene but with different exposures and then combining them into one, resulting into an image with a dynamic range higher than the individually captured frames."Compositing Multiple Pictures of the Same Scene", by Steve Mann, in IS&T's 46th Annual Conference, Cambridge, Massachusetts, May 9–14, 1993{{cite book|author1=Reinhard, Erik|title=High dynamic range imaging: acquisition, display, and image-based lighting|author2=Ward, Greg|author3=Pattanaik, Sumanta|author4=Debevec, Paul|publisher=Elsevier/Morgan Kaufmann|year=2005|isbn=978-0-12-585263-0|location=Amsterdam|page=7|quote=Images that store a depiction of the scene in a range of intensities commensurate with the scene are what we call HDR, or "radiance maps". On the other hand, we call images suitable for display with current display technology LDR.}}

Some of the sensors on modern phones and cameras may even combine the two images on-chip. This also allows a wider dynamic range being directly available to the user for display or processing without in-pixel compression. Some cameras designed for use in security applications can capture HDR videos by automatically providing two or more images for each frame, with changing exposure. For example, a sensor for 30fps video will give out 60fps with the odd frames at a short exposure time and the even frames at a longer exposure time.{{Citation needed|date=November 2017}}

Modern CMOS image sensors can often capture high dynamic range images from a single exposure.{{cite book|author=Arnaud Darmont|url=http://spie.org/x648.html?product_id=903927|title=High Dynamic Range Imaging: Sensors and Architectures|date=2012|publisher=SPIE press|isbn=978-0-81948-830-5|edition=First}} This reduces the need to use the multi-exposure HDR capture technique.

High dynamic range images are used in extreme dynamic range applications like welding or automotive work. In security cameras the term used instead of HDR is "wide dynamic range".{{Citation needed|date=November 2017}}

Because of the nonlinearity of some sensors image artifacts can be common.{{Citation needed|date=November 2017}}

= Rendering =

{{Main|High-dynamic-range rendering}}

High-dynamic-range rendering (HDRR) is the real-time rendering and display of virtual environments using a dynamic range of 65,535:1 or higher (used in computer, gaming, and entertainment technology).{{cite web|author=Simon Green and Cem Cebenoyan|year=2004|title=High Dynamic Range Rendering (on the GeForce 6800)|url=http://download.nvidia.com/developer/presentations/2004/6800_Leagues/6800_Leagues_HDR.pdf|work=GeForce 6 Series|publisher=nVidia|page=3}} HDRR does not require a HDR display and originally used tone mapping to display the rendering on a standard dynamic range display.

= Dynamic range compression or expansion =

{{Main|Tone mapping}}

The technologies used to store, transmit, display and print images have limited dynamic range. When captured or created images have a higher dynamic range, they must be tone mapped in order to reduce that dynamic range.{{Citation needed|date=December 2021}}

= Storage =

High-dynamic-range formats for image and video files are able to store more dynamic range than traditional 8-bit gamma formats. These formats include:

  • HDR formats that can be used for both storage and transmission to HDR displays, such as:
  • For video:
  • HDR10
  • HDR10+
  • Dolby Vision
  • HLG (backwards compatible with SDR displays)
  • For images:
  • Gain map approaches, which adds a conversion layer on top of SDR data. The result is backwards compatible with SDR displays and storage.
  • ISO 21496-1 Gain Map, evolved from a unification of Apple and Adobe's proposals.{{cite conference|title=Embedded Gain Maps for Adaptive Display of High Dynamic Range Images|conference=Stereoscopic Displays and Applications XXXIV|url=https://www.youtube.com/watch?v=HBVBLV9KZNI|date=January 2023|last1=Chan|first1=Eric (Adobe)|last2=Hubel|first2=Paul M. (Apple)}} Used by Apple under the name Adaptive HDR.{{Cite web |last=Benz |first=Greg |date=2024-09-27 |title=What do Apple's latest updates mean for HDR photography? |url=https://gregbenzphotography.com/hdr-photos/apple-macos-ios-hdr-iso-gain-map-21496-1/ |access-date=2024-11-10 |website=Greg Benz Photography |language=en-US}} It is supported starting with MacOS 15, iOS 18, iPadOS 18, Android 15, and Chromium based browsers.{{Cite web |last=Rahman |first=Mishaal |date=2024-10-29 |title=Google and Apple are making HDR photos work better on Android and iOS |url=https://www.androidauthority.com/google-apple-hdr-photo-standard-3495035/ |access-date=2024-11-10 |website=Android Authority |language=en}}
  • Apple Gain Map, which is not fully documented publicly, although documentation is available to decode these images.
  • Adobe Gain Map, a gain map image in a JPEG image file;{{cite web |last1=Chan |first1=Eric |title=Gain Maps, Version 1.0 draft 14 |url=https://helpx.adobe.com/content/dam/help/en/camera-raw/using/gain-map/jcr_content/root/content/flex/items/position/position-par/table/row-io13dug-column-4a63daf/download_section/download-1/Gain_Map_1_0d14.pdf |website=October 7, 2023 |access-date=20 June 2024}} used by Google under the name Ultra HDR and by Samsung under the name Super HDR.{{Cite web |title=Ultra HDR Image Format v1.1 |url=https://developer.android.com/guide/topics/media/platform/hdr-image-format |access-date=2024-11-10 |website=Android Developers |language=en}}{{Cite web |last=Benz |first=Greg |date=2022-08-24 |title=Create and edit true HDR (High Dynamic Range) images |url=https://gregbenzphotography.com/hdr/ |access-date=2024-11-10 |website=Greg Benz Photography |language=en-US}}{{Cite web |last=Romero |first=Andrew |date=2024-04-02 |title=Samsung's Super HDR is not coming to older Galaxy devices |url=https://9to5google.com/2024/04/02/samsungs-super-hdr-on-older-galaxy/ |access-date=2024-11-11 |website=9to5Google}} Supports gain on 1 or 3 channels. The Ultra HDR and ISO 21496-1 formats are encoded simultaneously in Android 15.
  • AVIF is compatible with gain maps, but currently no encoder is available.{{Cite web |last=Benz |first=Greg |date=2022-08-24 |title=HDR - AVIF: the future of HDR |url=https://gregbenzphotography.com/hdr/ |access-date=2024-11-11 |website=Greg Benz Photography |language=en-US}}
  • Apple EDR (Extreme Dynamic Range), used in macOS and iOS.{{Cite web |last=Benz |first=Greg |date=2022-08-24 |title=HDR Standards |url=https://gregbenzphotography.com/hdr/#standards |access-date=2024-11-11 |website=Greg Benz Photography |language=en-US}} Apple refers to EDR as the combination of hardware and software that allows displaying SDR and HDR content on the same screen.{{Cite web |date=2020-12-04 |title=Apple's "EDR" Brings High Dynamic Range to Non-HDR Displays |url=https://prolost.com/blog/edr |access-date=2024-11-11 |website=Prolost |language=en-US}}
  • HEIC (HEVC codec in HEIF file format)
  • AVIF (AV1 codec in HEIF file format)
  • JPEG XR
  • JPEG XL{{Cite web |date=9–15 April 2018 |title=ISO/IEC JTC 1/SC29/WG1 |url=https://jpeg.org/downloads/jpegxl/jpegxl-cfp.pdf |access-date=21 February 2021}}
  • HSP, CTA 2072 HDR Still Photo Interface (a format used by Panasonic cameras for photo capture in HDR with the HLG transfer function){{Cite web |title=Press Release - A New Hybrid Full-Frame Mirrorless Camera, the LUMIX S5 Featuring Exceptional Image Quality in High Sensitivity Photo/Video And Stunning Mobility |url=https://www.panasonic.com/content/dam/Panasonic/Global/Learn-More/Lumix-s/DC-S5_PressRelease.pdf |access-date=21 February 2021}}
  • Formats that are only used for storage purpose, such as:
  • Raw image formats
  • Formats that use a linear transfer function with high bit-depth
  • Formats that use a logarithmic transfer function
  • OpenEXR was created in 1999 by Industrial Light & Magic (ILM) and released in 2003 as an open source software library.{{cite press release |title=Industrial Light & Magic Releases Proprietary Extended Dynamic Range Image File Format OpenEXR to Open Source Community |date=22 January 2003 |url=http://www.openexr.com/OpenEXR_Press_Release_1_22_03.pdf |access-date=27 July 2016 |url-status=dead |archive-url=https://web.archive.org/web/20170721234341/http://www.openexr.com/OpenEXR_Press_Release_1_22_03.pdf |archive-date=21 July 2017}}{{cite web |title=Main OpenEXR web site |url=http://www.openexr.com |url-status=live |archive-url=https://web.archive.org/web/20130116040818/http://www.openexr.com/ |archive-date=16 January 2013 |access-date=27 July 2016}} OpenEXR is used for film and television production.
  • Academy Color Encoding System (ACES) was created by the Academy of Motion Picture Arts and Sciences and released in December 2014.{{cite news |title=ACES |url=http://www.oscars.org/science-technology/sci-tech-projects/aces |url-status=live |archive-url=https://web.archive.org/web/20160801233103/http://oscars.org/science-technology/sci-tech-projects/aces |archive-date=1 August 2016 |access-date=29 July 2016 |publisher=Academy of Motion Picture Arts and Sciences}} ACES is a complete color and file management system that works with almost any professional workflow and it supports both HDR and wide color gamut.

= Transmission to displays =

{{Main|High-dynamic-range video}}

High dynamic range (HDR) is also the common name of a technology allowing to transmit high dynamic range videos and images to compatible displays. That technology also improves other aspects of transmitted images, such as color gamut.

In this context,

  • HDR displays refers to displays compatible with that technology.
  • HDR formats refers to formats such as HDR10, HDR10+, Dolby Vision and HLG.
  • HDR video refers to a video encoded in an HDR format. Thoses HDR video have a greater bit depth, luminance and color volume than standard dynamic range (SDR) video which uses a conventional gamma curve.{{cite news|author=T. Borer|author2=A. Cotton|title=A "Display Independent" High Dynamic Range Television System|publisher=BBC|url=http://downloads.bbc.co.uk/rd/pubs/whp/whp-pdf-files/WHP309.pdf|access-date=2015-11-01}}

On January 4, 2016, the Ultra HD Alliance announced their certification requirements for an HDR display.{{cite news|date=2016-01-04|title=UHD Alliance Defines Premium Home Entertainment Experience|publisher=Business Wire|url=http://www.businesswire.com/news/home/20160104006605/en/UHD-Alliance-Defines-Premium-Home-Entertainment-Experience|access-date=2016-07-24}}{{cite news|date=2016-03-11|title=What is UHD Alliance Premium Certified?|publisher=CNET|url=http://www.cnet.com/news/what-is-uhd-alliance-premium-certified/|access-date=2016-07-24}} The HDR display must have either a peak brightness of over 1000 cd/m2 and a black level less than 0.05 cd/m2 (a contrast ratio of at least 20,000:1) or a peak brightness of over 540 cd/m2 and a black level less than 0.0005 cd/m2 (a contrast ratio of at least 1,080,000:1). The two options allow for different types of HDR displays such as LCD and OLED.

Some options to use HDR transfer functions that better match the human visual system other than a conventional gamma curve include the HLG and perceptual quantizer (PQ).{{cite news|author=Adam Wilt|date=2014-02-20|title=HPA Tech Retreat 2014 – Day 4|publisher=DV Info Net|url=http://www.dvinfo.net/article/trip_reports/hpa-tech-retreat-2014-day-4.html|access-date=2014-11-05}}{{cite news|author=Bryant Frazer|date=2015-06-09|title=Colorist Stephen Nakamura on Grading Tomorrowland in HDR|publisher=studiodaily|url=http://www.studiodaily.com/2015/06/colorist-stephen-nakamura-grading-tomorrowland-dolby-vision/|access-date=2015-09-21}} HLG and PQ require a bit depth of 10-bits per sample.

= Display =

{{See also|History of display technology|Backlight#Backlight dimming|OLED|High-dynamic-range television}}

The dynamic range of a display refers to range of luminosity the display can reproduce, from the black level to its peak brightness.{{Citation needed|date=December 2021}} The contrast of a display refers to the ratio between the luminance of the brightest white and the darkest black that a monitor can produce.{{Cite web|title=Our Monitor Picture Quality Tests: Contrast|url=https://www.rtings.com/monitor/tests/picture-quality/contrast-ratio|access-date=2021-12-29|website=RTINGS.com|language=en-US}} Multiple technologies allowed to increase the dynamic range of displays.

In May 2003, BrightSide Technologies demonstrated the first HDR display at the Display Week Symposium of the Society for Information Display. The display used an array of individually-controlled LEDs behind a conventional LCD panel in a configuration known as "local dimming". BrightSide later introduced a variety of related display and video technologies enabling visualization of HDR content.{{Cite journal|last1=Seetzen|first1=Helge|last2=Whitehead|first2=Lorne A.|last3=Ward|first3=Greg|date=2003|title=54.2: A High Dynamic Range Display Using Low and High Resolution Modulators|url=https://sid.onlinelibrary.wiley.com/doi/abs/10.1889/1.1832558|journal=SID Symposium Digest of Technical Papers|language=en|volume=34|issue=1|pages=1450–1453|doi=10.1889/1.1832558|s2cid=15359222 |issn=2168-0159}} In April 2007, BrightSide Technologies was acquired by Dolby Laboratories.{{Cite web|title=Dolby Laboratories (DLB) Acquires BrightSide for $28M|url=https://www.streetinsider.com/Mergers+and+Acquisitions/Dolby+Laboratories+%28DLB%29+Acquires+BrightSide+for+%2428M/1712967.html|access-date=2021-08-17|website=StreetInsider.com}}.

OLED displays have high contrast. MiniLED improves contrast.{{Citation needed|date=December 2021}}

=Realtime HDR vision=

File:MannGlas welding helmet 2views.jpg.]]

In the 1970s and 1980s, Steve Mann invented the Generation-1 and Generation-2 "Digital Eye Glass" as a vision aid to help people see better with some versions being built into welding helmets for HDR vision.[http://www.slashgear.com/quantigraphic-camera-promises-hdr-eyesight-from-father-of-ar-12246941/ Quantigraphic camera promises HDR eyesight from Father of AR, by Chris Davies, SlashGear, Sep 12th 2012]{{cite web |url=https://spectrum.ieee.org/why-smart-glasses-might-not-make-you-smarter |publisher=IEEE Spectrum |title=Why Smart Glasses Might Not Make You Smarter |first=Elise |last=Ackerman |date=31 Dec 2012 | access-date=1 Jan 2017}}{{cite journal |url=http://wearcam.org/ieeecomputer/r2025.htm |journal=IEEE Computer |volume=30 |issue=2 |date=February 1997 |title=Wearable Computing: A First Step Toward Personal Imaging |first=Steve |last=Mann|pages=25–32 |doi=10.1109/2.566147 |s2cid=28001657 }}{{Cite web |url=http://moteandbeam.net/eyetap-HDR-welding |title=A magical welding helmet that lets you see the world in HDR–in real-time |access-date=2018-03-24 |archive-url=https://web.archive.org/web/20160328192646/http://moteandbeam.net/eyetap-hdr-welding/ |archive-date=2016-03-28 |url-status=dead }}{{cite journal |url=http://wearcam.org/glassage |title=Through the Glass, Lightly |journal=IEEE Technology and Society Magazine |volume=31 |issue=3 |date=Fall 2012 |pages=10–14 |doi=10.1109/MTS.2012.2216592 |first=Steve |last=Mann}}{{cite journal |url=http://wearcam.org/glass.pdf |title='GlassEyes': The Theory of EyeTap Digital Eye Glass, supplemental material for 'Through the Glass, Lightly' |journal=IEEE Technology and Society Magazine |volume=31 |issue=3 |date=Fall 2012}}

Non-imaging

= Audio =

In Audio, the term high dynamic range means there is a lot of variation in the levels of the sound. Here, the dynamic range refers to the range between the highest volume and lowest volume of the sound.

XDR (audio) is used to provide higher-quality audio when using microphone sound systems or recording onto cassette tapes.

HDR Audio is a dynamic mixing technique used in EA Digital Illusions CE Frostbite Engine to allow relatively louder sounds to drown out softer sounds.{{cite web | url= https://www.youtube.com/watch?v=iey04xp2lUc |archive-url=https://ghostarchive.org/varchive/youtube/20211222/iey04xp2lUc |archive-date=2021-12-22 |url-status=live| title= Battlefield: Bad Company - Frostbite Engine Trailer | author= EA DICE/Electronic Arts | format=video | year=2007 | publisher=Electronic Arts}}{{cbignore}}

Dynamic range compression is a set of techniques used in audio recording and communication to put high-dynamic-range material through channels or media of lower dynamic range. Optionally, dynamic range expansion is used to restore the original high dynamic range on playback.

=Radio=

In radio, high dynamic range is important especially when there are potentially interfering signals. Measures such as spurious-free dynamic range are used to quantify the dynamic range of various system components such as frequency synthesizers. HDR concepts are important in both conventional and software-defined radio design.

=Instrumentation=

In many fields, instruments need to have a very high dynamic range. For example, in seismology, HDR accelerometers are needed, as in the ICEARRAY instruments.

See also

{{clear}}

References

{{Reflist}}