PrimeSense

PrimeSense was a fabless semiconductor company and provided products in the area of sensory inputs for consumer and commercial markets.

PrimeSense's technology had been originally applied to gaming but was later applied in other fields.{{cite web|url=http://www2.technologyreview.com/tr50/primesense/|title=PrimeSense - MIT Technology Review|website=2.technologyreview.com|access-date=3 August 2018}} PrimeSense was best known for licensing the hardware design and chip used in Microsoft's Kinect motion-sensing system for the Xbox 360 in 2010.{{cite web|url=https://venturebeat.com/2013/01/20/beyond-kinect-primesense-wants-to-drive-3d-sensing-into-more-everyday-consumer-gear/#FoKgcL7l6z2qct25.99|title=Beyond Kinect, PrimeSense wants to drive 3D sensing into more everyday consumer gear|date=20 January 2013|website=Venturebeat.com|access-date=3 August 2018}} The company had been founded in 2005 to explore depth-sensing cameras which they had demonstrated to developers at the 2006 Game Developers Conference. Microsoft had been looking on its own at 3D camera technology applications to its Xbox line of consoles, and engaged with PrimeSense after the conference to help establish the direction the technology needed to go to make it into consumer-grade products, while Microsoft improved on additional software aspects and incorporated machine learning to help with motion detection.{{cite web | url = https://www.polygon.com/2020/1/14/21064608/microsoft-kinect-history-rise-and-fall | title = All the money in the world couldn't make Kinect happen | first = Blake | last =Hester | date = January 14, 2020 | access-date = January 16, 2020 | work = Polygon }}

On November 24, 2013, Apple Inc. confirmed the purchase of PrimeSense for $360 million.{{cite web|url=http://allthingsd.com/20131124/apple-confirms-acquisition-of-3d-sensor-startup-primesense/|title=Apple Confirms Acquisition of 3-D Sensor Startup PrimeSense|website=Allthingsd.com|access-date=3 August 2018}}

PrimeSense's depth acquisition was enabled by "light coding" technology. The process coded the scene with near-IR light, light that returns distorted depending upon where things are (Structured light). The solution then used a standard off-the-shelf CMOS image sensor to read the coded light back from the scene using various algorithms to triangulate and extract the 3D data. The product analysed scenery in 3 dimensions with software, so that devices could interact with users.{{cite web|url=http://forwardthinking.pcmag.com/gadgets/282321-primesense-motion-control-beyond-the-kinect|title=PrimeSense: Motion Control Beyond the Kinect|website=Forwardthinking.pcmag.com|access-date=3 August 2018}}{{cite web |url=http://www.primesense.com/solutions/technology/ |title=Technology - PrimeSense |access-date=2013-02-26 |url-status=dead |archive-url=https://web.archive.org/web/20131102094504/http://www.primesense.com/solutions/technology/ |archive-date=2013-11-02 }}

The CMOS image sensor worked with the visible video sensor to enable the depth map provided by PrimeSense SoC's Carmine (PS1080) and Capri (PS1200) to be merged with the color image. The SoCs performed a registration process so the color image (RGB) and depth (D) information was aligned properly.{{cite web|url=http://electronicdesign.com/embedded/how-microsoft-s-primesense-based-kinect-really-works|title=How Microsoft's PrimeSense-based Kinect Really Works|date=16 March 2011|website=Electronicdesign.com|access-date=3 August 2018}} The light coding infrared patterns were deciphered in order to produce a VGA size depth image of a scene. It delivered visible video, depth, and audio information in a synchronized fashion via the USB 2.0 interface. The SoC had minimal CPU requirements as all depth acquisition algorithms ran on the SoC itself.

• Carmine 1.08
• Carmine 1.09 (short range)
• Capri 1.25 (embedded)

PrimeSense embedded its technology in its own sensors, the Carmine 1.08 and Carmine 1.09. Capri 1.25, touted by the company as the world's smallest 3D sensor, debuted at International CES 2013.{{cite web|url=https://www.engadget.com/2013/01/11/primesense-capri-hands-on/|title=PrimeSense shows off tiny Capri sensor, yearns for 3D-sensing future (hands-on)|website=Engadget.com|access-date=3 August 2018}}

PrimeSense developed NiTE middleware which analyzed the data from hardware and modules for OpenNI providing gesture and skeleton tracking. They were released only as binaries.{{cite web|url=http://wiki.debian.org/PrimeSenseNite|title=PrimeSenseNite - Debian Wiki|website=Wiki.debian.org|access-date=3 August 2018}} According to the NiTE LinkedIn page: "Including computer vision algorithims, NiTE identifies users and tracks their movements, and provides the framework API for implementing natural-interaction UI controls based on gestures."{{Cite web|url=http://www.linkedin.com/company/primesense/nite-middleware-902678/product|archive-url=https://archive.today/20130408174513/http://www.linkedin.com/company/primesense/nite-middleware-902678/product|url-status=dead|archive-date=2013-04-08|title = NiTE Middleware | LinkedIn}} The system could then interpret specific gestures, making completely hands-free control of electronic devices a reality. Including:

• Identification of people their body properties, movements and gestures
• Classification of objects such as furniture
• Location of walls and floor

PrimeSense's original focus was on the gaming and living room markets,{{cite web|url=https://www.forbes.com/sites/nicoleperlroth/2010/12/13/for-primesense-microsofts-kinect-is-just-the-beginning/|title=For PrimeSense, Microsoft's Kinect Is Just the Beginning|first=Nicole|last=Perlroth|website=Forbes.com|access-date=3 August 2018}} but expanded to include:

• Kinect by Microsoft was powered by PrimeSense technology that allowed gamers to use their entire body to control play, action and movement of their onscreen characters.

• WAVI Xtion for the PC by ASUS used PrimeSense's core 3D sensing solution, developed primarily for browsing multimedia content, accessing Web sites and social networks when the PC was hooked up to the living room TV.{{cite web|url=http://www.tomshardware.com/news/Motion-Sensing-Kinect-PrimeSense-WAVI-Xtion-Xbox-360,11874.html|title=Asus, PrimeSense Reveals Motion Sensing for PC|date=3 January 2011|website=Tomshardware.com|access-date=3 August 2018}}
• [Structure Sensor] Mobile 3D sensor by Occipital used a custom chip based on PrimeSense's 3D sensing solution. The sensor itself was designed to easily attach to a wide range of devices, including the Apple iPad, Android tablets and desktop platforms such as Windows, OS X and Linux.{{cite web|url=http://structure.io|title=Official Structure Sensor Store - Give Your iPad 3D Vision|website=structure.io|access-date=3 August 2018}}

• Firecube SMART by Firecube Public Multimedia: An interactive multimedia solution for games, presentations and attractions in public spaces.[http://www.firecube-multimedia.com/lang/en www.firecube-multimedia.com/lang/en] {{webarchive|url=https://web.archive.org/web/20150108131501/http://www.firecube-multimedia.com/lang/en |date=2015-01-08 }}
• EyePlay by Eyeclick - an interactive video gaming system with 3D interactive projection capabilities.{{cite web|url=http://www.eyeclick.com|title=BEAM By EyeClick - Interactive Gaming Projector System|website=BEAM By EyeClick|access-date=3 August 2018}}
• ViiMotion by Covii:an Interactive Software Device, created to provide generic or custom interactive applications through computer vision.{{cite web|url=https://vimeo.com/27158262|title=ViiMotion - Interactive Software Device by Covii|website=Vimeo|access-date=3 August 2018}}
• Interactive Projector by Ayotle: an interactive solution that used a depth sensor to make any real or imaginary surface act like a tactile or contactless interactive device.{{Cite web |url=http://www.3dvisworld.com/news/technology-news/3672-new-ayotle-anytouch-3d-tactile-touchscreen.html |title=New Ayotle AnyTouch 3D Tactile Touchscreen - 3D Visualization World |access-date=2013-02-26 |archive-url=https://web.archive.org/web/20160307052408/https://www.3dvisworld.com/news/technology-news/3672-new-ayotle-anytouch-3d-tactile-touchscreen.html |archive-date=2016-03-07 |url-status=dead }}
• Finger Tracking MW by 3Gear Systems: a precise tracking system that used computer graphics algorithms for reconstructing the precise pose of the user's hands from 3D cameras{{cite web|url=http://remotepresence.org/?p=394|archive-url=https://web.archive.org/web/20130731122139/http://remotepresence.org/?p=394|url-status=usurped|archive-date=July 31, 2013|title=Finger-precise hand gesture tracking - Remote Presence Magazine|date=18 October 2012|website=Remotepresence.org|access-date=3 August 2018}}

• SmartFit by Styku:a multi-channel retail platform for fit prediction and visualization
• Bodymetrics pod by Bodymetrics: a full 3D body scanner that was designed to calculate measurements which are then analyzed and used to find suitable garments.{{cite web|url=http://www.gizmag.com/bodymetrics-body-mapping-for-clothes-fitting/20270/|title=Bodymetrics pods scan customers' bodies to get their clothing measurements|website=Gizmag.com|date=26 October 2011|access-date=3 August 2018}}
• Matterport Pro 3D Camera by Matterport: a consumer 3D camera that creates immersive panoramic tours with an underlying 3D mesh.{{cite web|url=https://angel.co/matterport|title=Matterport|website=Angel.co|access-date=3 August 2018}}

• SAMI by Criif: PrimeSense sensors allow the humanoid robot to be fully autonomous in the house or specific environment.{{Cite web |url=http://visionaryexcellence.com/tag/criif/ |title=CRIIF | Visionary Excellence |access-date=2013-02-26 |archive-url=https://web.archive.org/web/20150414082832/http://visionaryexcellence.com/tag/criif/ |archive-date=2015-04-14 |url-status=dead }}

• Ava by iRobot: an autonomous mobile robotics platform{{cite web|url=https://www.engadget.com/2012/02/29/irobot-reorganizes-forms-new-unit-focused-on-ava-and-other-emer/|title=iRobot reorganizes, forms new unit focused on Ava and other emerging technologies|website=Engadget.com|access-date=3 August 2018}}

• 2005
• PrimeSense is founded
• 2010
• Microsoft names PrimeSense as Project Natal partner{{cite web|url=http://www.globes.co.il/serveen/globes/docview.asp?did=1000550536&fid=942|title=Microsoft names Israel's PrimeSense as Project Natal partner - Globes|website=Globes|date=31 March 2010|access-date=3 August 2018}}
• 2011
• PrimeSense raises a round of private equity funding as part of its plan to expand its motion-control chips{{cite news|url=https://www.reuters.com/article/idUS167050511820110112|title=PrimeSense raises round for motion-control chips|first=Dean|last=Takahashi|website=Reuters.com|date=13 January 2011|access-date=3 August 2018}}
• PrimeSense is selected by MIT Technology Review for World's Ten Most Important Technologies
• 2012
• PrimeSense is selected as a World Economic Forum Technology Pioneer
• Announces the launch of its next generation embedded 3D sensor, Capri 1.25

• Occipital
• Covii
• DotProduct
• Matterport
• 3Gear Systems
• Ayotle
• Willow Garage
• Open Perception
• [http://www.shopperception.com Shopperception]
• SideKick
• MediaStanza
• ASUS, the only remaining source of sensors based on PrimeSense technology

PrimeSense was a founding member of OpenNI, an industry-led, non-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware. The original OpenNI project was shut down by Apple when they bought the open source software, but Occipital kept a forked version of OpenNI 2 active as an open source software for the SDK for their Structure Product.{{Citation needed|date=February 2017}}

The company provided the 3D sensing technology for the first Kinect, previously known as Project Natal.{{Cite web|last=Gohring|first=Nancy|title=Mundie: Microsoft's Research Depth Enabled Kinect|url=https://www.pcworld.com/article/202184/mundie_microsofts_research_depth_enabled_kinect.html|publisher=PC World|access-date=2 August 2010|date=29 July 2010}}{{Cite web|last=Corp.|first=Microsoft|title=PrimeSense Supplies 3-D-Sensing Technology to "Project Natal" for Xbox 360|website=Microsoft |url=http://www.microsoft.com/Presspass/press/2010/mar10/03-31PrimeSensePR.mspx|access-date=2 August 2010|date=10 March 2010}}

The company was selected by MIT Technology Review magazine as one of world's 50 most innovative companies for 2011.{{cite web|url=http://www.technologyreview.com/tr50/|title=The 50 Smartest Companies of 2017 might not be what you think|website=Technologyreview.com|access-date=3 August 2018}}

PrimeSense won Design Team of the Year in EE Times 2011 Annual Creativity in Electronics (ACE){{Cite web |url=http://www.eetimes.com/electronics-news/4215731/EE-Times-honors-2011-ACE-Award-winners |title=EE Times honors 2011 ACE Award winners |access-date=2013-02-26 |archive-url=https://web.archive.org/web/20121014233305/http://www.eetimes.com/electronics-news/4215731/EE-Times-honors-2011-ACE-Award-winners |archive-date=2012-10-14 |url-status=dead }}

PrimeSense was honored as a World Economic Forum Technology Pioneer in 2013.{{cite web|url=http://reports.weforum.org/technology-pioneers-2013/|title=Technology Pioneers 2013|website=Reports.weforum.org|access-date=3 August 2018}}

{{Reflist}}

• {{web archive|url=https://web.archive.org/web/20120922202944/http://www.primesense.com/|title=Official website}}
• [http://www.eurogamer.net/articles/digitalfoundry-primesense-article PrimeSense: Beyond Natal]
• [http://www.joystiq.com/2010/06/19/kinect-how-it-works-from-the-company-behind-the-tech/ Kinect: The company behind the tech explains how it works]
• [http://revolucionamos.com/matterport-partner-realidad-virtual-3d-barcelona-espana-precios MatterPort Spain Barcelona]

{{Apple}}

Category:Electronics companies established in 2005

Category:2005 establishments in Israel

Category:Electronics companies of Israel

Category:Fabless semiconductor companies

Category:Semiconductor companies of Israel

Category:Apple Inc. acquisitions

Category:2013 mergers and acquisitions

Category:Mergers and acquisitions of Israeli companies

Category:Israeli inventions