2D-plus-depth

The 2D-plus-Depth format is described in a Philips' white paper{{Cite web |url=http://www.business-sites.philips.com/shared/assets/global/Downloadablefile/Philips-3D-Interface-White-Paper-13725.pdf |archive-url=https://web.archive.org/web/20110715074939/http://www.business-sites.philips.com/shared/assets/global/Downloadablefile/Philips-3D-Interface-White-Paper-13725.pdf |url-status=dead |archive-date=2011-07-15 |title=Philips 3D Solutions: 3D Interface Specifications White Paper |access-date=2010-06-03 }} and articles.{{Cite conference |title=Philips 3D Solutions: From Content Creation to Visualization | conference = Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06) |doi=10.1109/3DPVT.2006.107 |year =2006 | author1= Redert, Andre | display-authors = etal }}

Each 2D image frame is supplemented with a greyscale depth map which indicates if a specific pixel in the 2D image needs to be shown in front of the display (white) or behind the screen plane (black). The 256 greyscales can build a smooth gradient of depth within the image. Processing within the monitor used this input to render the multiview images.

Supported by various companies across the display industry, 2D-plus-Depth has been standardized in MPEG as an extension for 3D filed under ISO/IEC FDIS 23002-3:2007(E).[http://webstore.iec.ch/preview/info_isoiec23002-3%7Bed1.0%7Den.pdf Preview of "ISO/IEC 23002-3. Information technology — MPEG video technologies — Part 3: Representation of auxiliary video and supplemental information"]

There is also an extension on the 2D-plus-Depth format called the WOWvx Declipse format. It is described in the same Philips' white paper "3D Interface Specifications". In this advanced format, two more planes are added to the original 2D image and its depth map for each frame: the background areas covered by foreground objects and their respective depth map. So, each frame in the Declipse format is described with an image containing four parts, or quadrants. This extension improves potential visual quality by providing data for more correct and precise filling of the uncovered occlusion areas created by shifting foreground objects during the multiview generation process.

2D-plus-Depth has the advantage that it has a limited bandwidth increase compared to 2D (compressed greyscale increases bandwidth 5–20%) so that it can be used in existing distribution infrastructures.

2D-plus-Depth offers flexibility and compatibility with existing production equipment and compression tools.{{Cite web |url=http://www.dimenco.eu/our-technology/3d-image-processing/ |title=2D+Z and its advantages |access-date=2014-03-17 |archive-url=https://web.archive.org/web/20140317143524/http://www.dimenco.eu/our-technology/3d-image-processing/ |archive-date=2014-03-17 |url-status=dead }}[http://sp.cs.tut.fi/mobile3dtv/results/tech/D2.2_Mobile3DTV_v1.0.pdf Adaptation and optimization of coding algorithms for mobile 3DTV]

It allows applications to use different 3D display screen sizes and designs in the same system.

Another advantage is that depth maps are created in the course of 2D-to-stereo 3D conversion using almost any approach to this video transformation.[http://effectscorner.blogspot.com/2011/08/2d-to-3d-conversions.html 2D to 3D Conversions by Scott Squires] That is why there is the respective 2D-plus-Depth representation of a converted stereo footage in almost all cases. Considering the lack of 3D content shot in stereo and the number of converted 3D films, this is a big benefit.

2D-plus-Depth is not compatible with existing 2D or 3D-Ready displays. The format has been criticized due to the limited amount of depth that can be displayed in an 8-bit greyscale.

2d-plus-Depth cannot handle transparency (semi-transparent objects in the scene) and occlusion (an object blocking the view of another). The 2d plus DOT format takes these factors into account.Bernard F. Coll, Faisal Ishtiaq, Kevin O'Connell (2010) [http://enpub.fulton.asu.edu/resp/vpqm/vpqm10/Proceedings_VPQM2010/vpqm_p33.pdf "3DTV at home: Status, challenges and solutions for delivering a high quality experience"] {{Webarchive|url=https://web.archive.org/web/20110719142054/http://enpub.fulton.asu.edu/resp/vpqm/vpqm10/Proceedings_VPQM2010/vpqm_p33.pdf |date=2011-07-19 }} Proceedings VPQM 2010 Additionally, it cannot handle reflection, refraction (beyond simple transparency) and other optical phenomena.

Creation of accurate 2D-plus-Depth can be costly and difficult, though recent advances in range imaging have made this process more accessible.Wilson, Andrew (July 1, 2004). [http://www.vision-systems.com/display_article/207872/19/none/none/Techt/CMOS-single-chip-sensor-captures-3-D-images “CMOS single-chip sensor captures 3-D images”] {{Webarchive|url=https://archive.today/20130205190855/http://www.vision-systems.com/display_article/207872/19/none/none/Techt/CMOS-single-chip-sensor-captures-3-D-images |date=2013-02-05 }}. Vision Systems.Spare, James (August, 2004). [http://archives.sensorsmag.com/articles/0804/32/main.shtml “Machine vision: Adding the Third Dimension. Electronic perception technology is a new way to make direct, rather than derived, depth measurements of target objects”] {{Webarchive|url=https://web.archive.org/web/20061018173354/http://archives.sensorsmag.com/articles/0804/32/main.shtml |date=2006-10-18 }}. Sensors.

2d-plus-Depth lacks the potential increase in resolution of using two complete images.

Depth cannot be reliably estimated for a monocular video in most cases. Notable exceptions are camera motion scenes when object motion is static or almost absent, and landscape scenes when depth map can be approximated well enough with a gradient. This allows automatic depth estimation.[https://www.youtube.com/watch?v=wt-pCDLzfpw Automatic 2D to 2D-plus-Depth conversion sample for a camera motion scene][https://www.youtube.com/watch?v=djYz61H7gZk Automatic depth estimation from scene geometry] In general case only semi-automatic approach is viable for 2D to 2D-plus-Depth conversion. Philips developed a 3D content creation software suite named BlueBox{{Cite web |url=http://www.business-sites.philips.com/3dsolutions/3dcontentcreationproducts/bluebox |title=BlueBox -- a 3D content creation service suite generating 3D content in the 2D-plus-Depth format |access-date=2010-06-03 |archive-url=https://archive.today/20110715075045/http://www.business-sites.philips.com/3dsolutions/3dcontentcreationproducts/bluebox |archive-date=2011-07-15 |url-status=dead }} which includes semi-automated conversion of 2D content into 2D-plus-Depth format and automatic generation of 2D-plus-Depth from stereo. A similar semiautomatic approach to high quality 2D to 2D-plus-Depth conversion is implemented in YUVsoft's 2D to 3D Suite, available as a set of plugins for After Effects and NUKE video compositing software.[http://www.yuvsoft.com/products/2d-to-3d-conversion/ YUVsoft 2D to 3D Suite software for human-guided 2D-to-stereo 3D conversion]

Stereoscopic to 2D-plus-Depth conversion involves several algorithms including scene change detection, segmentation, motion estimation and image matching. Automatic stereo to 2D+Depth conversion is now possible due to new high performance software and GPU technology, even in live real-time mode.[https://www.youtube.com/watch?v=zhld5uJxFAM An example of automatic stereo to 2D+Depth conversion]

Other 3D formats are stereo (left-right or alternating frames) and multiview 3D format (such as Multiview Video Coding and Scalable Video Coding), and 2D plus Delta.

{{Reflist}}

{{Stereoscopy}}

{{DEFAULTSORT:2d-Plus-Depth}}

Category:Graphics file formats

Category:Stereoscopy