Skinput
{{Short description|Input technology}}Image:Skinput arm buttons.JPG
Skinput is an input technology that uses bio-acoustic sensing to localize finger taps on the skin. When augmented with a pico-projector, the device can provide a direct manipulation, graphical user interface on the body. The technology was developed by Chris Harrison, Desney Tan and Dan Morris, at Microsoft Research's Computational User Experiences Group.{{cite web | publisher = Microsoft Research Computational User Experiences Group | title = Skinput:Appropriating the Body as an Input Surface | url = http://research.microsoft.com/en-us/um/redmond/groups/cue/skinput | accessdate = 26 May 2010}} Skinput represents one way to decouple input from electronic devices with the aim of allowing devices to become smaller without simultaneously shrinking the surface area on which input can be performed. While other systems, like SixthSense have attempted this with computer vision, Skinput employs acoustics, which take advantage of the human body's natural sound conductive properties (e.g., bone conduction).{{cite journal |last = Harrison | first = Dan | title = Skinput:Appropriating the Body as an Input Surface | url = http://research.microsoft.com/en-us/um/redmond/groups/cue/publications/mkskinputchi2010.pdf | date = 10–15 April 2010 | journal = Proceedings of the ACM CHI Conference 2010}} This allows the body to be annexed as an input surface without the need for the skin to be invasively instrumented with sensors, tracking markers, or other items.
Microsoft has not commented on the future of the projects, other than it is under active development. In 2010, it was reported that this would not appear in commercial devices for at least 2 years.{{cite news | work = Wall Street Journal | url = https://blogs.wsj.com/digits/2010/04/26/the-skinny-on-touch-technology | title = The Skinny on Touch Technology | date = 26 April 2010 | last = Goode | first = Lauren}}
Operation
Image:Skinput Sensor Waveforms.jpg
Skinput has been publicly demonstrated as an armband, which sits on the biceps. This prototype contains ten small cantilevered Piezo elements configured to be highly resonant, sensitive to frequencies between 25 and 78 Hz.{{cite web | url = http://www.cnn.com/2010/TECH/04/19/microsoft.skinput/index.html | work = CNN | title = Microsoft's Skinput turns hands, arms into buttons | date = 19 April 2010 | last = Sutter | first = John}} This configuration acts like a mechanical Fast Fourier transform and provides extreme out-of-band noise suppression, allowing the system to function even while the user is in motion. From the upper arm, the sensors can localize finger taps provided to any part of the arm, all the way down to the finger tips, with accuracies in excess of 90% (as high as 96% for five input locations).{{cite news | url = http://news.bbc.co.uk/2/hi/8587486.stm | work = BBC News | title = Sensors turn skin into gadget control pad | last = Ward | first = Mark | date = 26 March 2010}} Classification is driven by a support vector machine using a series of time-independent acoustic features that act like a fingerprint. Like speech recognition systems, the Skinput recognition engine must be trained on the "sound" of each input location before use. After training, locations can be bound to interactive functions, such as pause/play song, increase/decrease music volume, speed dial, and menu navigation.
With the addition of a pico-projector to the armband, Skinput allows users to interact with a graphical user interface displayed directly on the skin. This enables several interaction modalities, including button-based hierarchical navigation, list-based sliding navigation (similar to an iPod/SmartPhone/MID), text/number entry (e.g., telephone number keypad), and gaming (e.g., Tetris, Frogger){{cite web | url = http://www.chrisharrison.net/projects/skinput | title = Skinput: Appropriating the Body as an Input Surface | format = blog | work = Chrisharrison.net}}{{cite web | url = https://www.youtube.com/watch?v=g3XPUdW9Ryg | work = Youtube (from CHI 2010 conference)| title = Skinput: Appropriating the Body as an Input Surface}}
Demonstrations
Despite being a Microsoft Research internal project, Skinput has been demonstrated publicly several times. The first public appearance was at Microsoft's TechFest 2010, where the recognition model was trained live on stage, during the presentation, followed by an interactive walkthrough of a simple mobile application with four modes: music player, email inbox, Tetris, and voice mail.{{cite news | url = http://seattletimes.nwsource.com/html/businesstechnology/2011227913_techfest02.html | work = Seattle Times | title = A peek at where Microsoft thinks we're going tomorrow | last = Dudley | first = Brier | date = 1 March 2010}} A similar live demo was given at the ACM CHI 2010 conference, where the academic paper received a "Best Paper" award. Attendees were allowed to try the system. Numerous media outlets have covered the technology,{{cite news | url = http://www.nbcnews.com/id/35708587 | archive-url = https://web.archive.org/web/20131103174431/http://www.nbcnews.com/id/35708587/ | url-status = dead | archive-date = November 3, 2013 | work = NBC News | title = 'Skinput' turns body into touchscreen interface | last = Hope | first = Dan | date = 4 March 2010}}{{cite news | url = http://news.cnet.com/8301-17938_105-10462255-1.html | work = CNET | title = Turn your arm into a phone with Skinput | last = Hornyak | first = Tom | date = 2 March 2010}}{{cite news | url = https://www.newscientist.com/article/dn18591-body-acoustics-can-turn-your-arm-into-a-touchscreen.html | work = New Scientist | title = Body acoustics can turn your arm into a touchscreen | last = Marks | first = Paul | date = 1 March 2010}}{{cite web | url = http://www.popsci.com/gadgets/article/2010-03/skinput-turns-your-skin-peripheral-input-device-youll-never-misplace | work = Popular Science | title = Skinput Turns Any Bodily Surface Into a Touch Interface | last = Dillow | first = Clay | date = 3 March 2010}}{{cite web | url = https://www.npr.org/templates/story/story.php?storyId=124303315&sc=emaf | work = National Public Radio | title = Technology: Skin Used As An Input Device | date = 4 March 2010 | format = interview transcript}} with several featuring live demos.{{cite web | url = https://www.engadget.com/2010/03/02/skinput-because-touchscreens-never-felt-right-anyway-video/ | work = Engadget | title = Skinput: because touchscreens never felt right anyway | format = video | last = Savov | first = Vladislav | date = 2 March 2010}}
References
{{reflist}}
External links
- [http://doi.acm.org/10.1145/1753326.1753394 ACM Digital Library - Skinput: appropriating the body as an input surface]