{"id":25266,"date":"2018-04-06T05:58:22","date_gmt":"2018-04-06T05:58:22","guid":{"rendered":"http:\/\/www.kurzweilai.net\/?p=311407"},"modified":"2018-04-13T18:17:03","modified_gmt":"2018-04-13T18:17:03","slug":"intelligence-augmentation-device-lets-users-speak-silently-with-a-computer-by-just-thinking","status":"publish","type":"post","link":"https:\/\/hoo.central12.com\/fugic\/2018\/04\/06\/intelligence-augmentation-device-lets-users-speak-silently-with-a-computer-by-just-thinking\/","title":{"rendered":"Intelligence-augmentation device lets users &lsquo;speak silently&rsquo; with a computer by just thinking"},"content":{"rendered":"<div id=\"attachment_311410\" class=\"wp-caption aligncenter\" style=\"width: 409px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-311410\" title=\"Alter Ego\" src=\"http:\/\/www.kurzweilai.net\/images\/Alter-Ego.png\" alt=\"\" width=\"399\" height=\"489\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">MIT Media Lab researcher Arnav Kapur demonstrates the AlterEgo device. It picks up neuromuscular facial signals generated by his thoughts; a bone-conduction headphone lets him privately hear responses from his personal devices. (credit: Lorrie Lejeune\/MIT)<\/p><\/div>\n<p>MIT researchers have invented a system that allows someone to communicate silently and privately with a computer or the internet by simply thinking &#8212; without requiring any facial muscle movement.<\/p>\n<p>The AlterEgo system consists of a wearable device with electrodes that pick up otherwise undetectable neuromuscular subvocalizations &#8212; saying words \u201cin your head\u201d in natural language. The signals are fed to a neural network that is trained to identify subvocalized words from these signals. Bone-conduction headphones also transmit vibrations through the bones of the face to the inner ear to convey information to the user &#8212; privately and without interrupting a conversation. The device connects wirelessly to any external computing device via Bluetooth.<\/p>\n<p><strong>A silent,\u00a0discreet, bidirectional conversation with machines. <\/strong>\u201cOur idea was: Could we have a computing platform that\u2019s more internal, that melds human and machine in some ways and that feels like an internal extension of our own cognition?,\u201d says Arnav Kapur, a graduate student at the MIT Media Lab who led the development of the new system. Kapur is first author on an <a href=\"http:\/\/delivery.acm.org\/10.1145\/3180000\/3172977\/p43-kapur.pdf?ip=71.70.154.219&amp;id=3172977&amp;acc=OPENTOC&amp;key=4D4702B0C3E38B35.4D4702B0C3E38B35.4D4702B0C3E38B35.9F04A3A78F7D3B8D&amp;__acm__=1523071486_b8c9a2b82231ec2b40909d5a7a5d2a30\" >open-access paper<\/a> on the research presented in March at the <a title=\"Conference Website\" href=\"http:\/\/iui.acm.org\/2018\/\" >IUI &#8217;18<\/a> 23rd International Conference on Intelligent User Interfaces.<\/p>\n<p>In one of the researchers\u2019 experiments, subjects used the system to silently report opponents\u2019 moves in a chess game and silently receive recommended moves from a chess-playing computer program. In another experiment, subjects were able to undetectably answer difficult computational problems, such as the square root of large numbers or obscure facts. The researchers achieved 92% median word accuracy levels, which is expected to improve.\u00a0 \u201cI think we\u2019ll achieve full conversation someday,\u201d Kapur said.<\/p>\n<p><iframe frameborder=\"0\" height=\"421\" src=\"https:\/\/www.youtube.com\/embed\/RuUSc53Xpeg\" width=\"628\"><\/iframe><\/p>\n<p><strong>Non-disruptive.<\/strong> \u201cWe basically can\u2019t live without our cellphones, our digital devices,\u201d says Pattie Maes, a professor of media arts and sciences and Kapur\u2019s thesis advisor. \u201cBut at the moment, the use of those devices is very disruptive. If I want to look something up that\u2019s relevant to a conversation I\u2019m having, I have to find my phone and type in the passcode and open an app and type in some search keyword, and the whole thing requires that I completely shift attention from my environment and the people that I\u2019m with to the phone itself.<\/p>\n<p>\u201cSo, my students and I have for a very long time been experimenting with new form factors and new types of experience that enable people to still benefit from all the wonderful knowledge and services that these devices give us, but do it in a way that lets them remain in the present.\u201d*<\/p>\n<hr \/>\n<blockquote><p><em>Even the tiniest signal to her jaw or larynx might be interpreted as a command. Keeping one hand on the sensitivity knob, she concentrated to erase mistakes the machine kept interpreting as nascent words.<\/em><\/p>\n<div id=\"yui_3_16_0_ym19_1_1522988086672_28594\"><em>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Few people used subvocals, for the same reason few ever became street jugglers. Not many could operate the delicate systems without tipping into chaos. Any normal mind kept intruding with apparent irrelevancies, many ascending to the level of muttered or almost-spoken words the outer consciousness hardly noticed, but which the device manifested visibly and in sound.<\/em><\/div>\n<div id=\"yui_3_16_0_ym19_1_1522988086672_28596\"><em>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Tunes that pop into your head&#8230; stray associations you generally ignore&#8230; memories that wink in and out&#8230; impulses to action&#8230; often rising to tickle the larynx, the tongue, stopping just short of sound&#8230;<\/em><\/div>\n<div id=\"yui_3_16_0_ym19_1_1522988086672_28598\"><em>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0As she thought each of those words, lines of text appeared on the right, as if a stenographer were taking dictation from her subvocalized thoughts. Meanwhile, at the left-hand periphery, an extrapolation subroutine crafted little simulations.\u00a0\u00a0A tiny man with a violin. A face that smiled and closed one eye&#8230;\u00a0It was well this device only read the outermost, superficial nervous activity, associated with the speech centers.<\/em><\/div>\n<div id=\"yui_3_16_0_ym19_1_1522988086672_28600\"><em>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0When invented, the sub-vocal had been hailed as a boon to pilots &#8212; until high-performance jets began plowing into the ground. We experience ten thousand impulses for every one we allow to become action.\u00a0Accelerating the choice and decision process did more than speed reaction time. It also shortcut judgment.<\/em><\/div>\n<div id=\"yui_3_16_0_ym19_1_1522988086672_28602\"><em>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Even as a computer input device, it was too sensitive for most people.\u00a0\u00a0Few wanted extra speed if it also meant the slightest sub-surface reaction could become embarrassingly real, in amplified speech or writing.<\/em><\/div>\n<div id=\"yui_3_16_0_ym19_1_1522988086672_28604\" dir=\"ltr\">\n<p><em>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0If they ever really developed a true brain to computer interface, the chaos would be even worse.<\/em><\/p>\n<p>&#8212; From <em>EARTH <\/em>(1989) chapter 35 by David Brin (with permission)<\/p>\n<\/div>\n<\/blockquote>\n<hr \/>\n<p><strong>IoT control<\/strong>. In the conference paper, the researchers suggest that an \u201cinternet of things\u201d (IoT) controller \u201ccould enable a user to control home appliances and devices (switch on\/off home lighting, television control, HVAC systems etc.) through internal speech, without any observable action.\u201d Or schedule an Uber pickup.<\/p>\n<p>Peripheral devices could also be directly interfaced with the system. \u201cFor instance, lapel cameras and smart glasses could directly communicate with the device and provide contextual information to and from the device. &#8230; The device also augments how people share and converse. In a meeting, the device could be used as a back-channel to silently communicate with another person.\u201d<\/p>\n<p>Applications of the technology could also include high-noise environments, like the flight deck of an aircraft carrier, or even places with a lot of machinery, like a power plant or a printing press, suggests Thad Starner, a professor in Georgia Tech\u2019s College of Computing. \u201cThere\u2019s a lot of places where it\u2019s not a noisy environment but a silent environment. A lot of time, special-ops folks have hand gestures, but you can\u2019t always see those. Wouldn\u2019t it be great to have silent-speech for communication between these folks? The last one is people who have disabilities where they can\u2019t vocalize normally.\u201d<\/p>\n<p><em>* Or users could, conceivably, simply zone out &#8212; checking texts, email messages, and twitter (all converted to voice) during boring meetings, or even reply, using mentally selected \u201csmart reply\u201d type options.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>MIT researchers have invented a system that allows someone to communicate silently and privately with a computer or the internet by simply thinking &mdash; without requiring any facial muscle movement. The AlterEgo system consists of a wearable device with electrodes that pick up otherwise undetectable neuromuscular subvocalizations &mdash; saying words &ldquo;in your head&rdquo; in natural [&#8230;]<\/p>\n","protected":false},"author":454,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49,47,56,53,43,808],"tags":[],"class_list":["post-25266","post","type-post","status-publish","format-standard","hentry","category-cognitive-scienceneuroscience","category-computersinfotechui","category-human-enhancement","category-internetcloudtelecom","category-news","category-social-networkingweb"],"_links":{"self":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/25266"}],"collection":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/users\/454"}],"replies":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/comments?post=25266"}],"version-history":[{"count":1,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/25266\/revisions"}],"predecessor-version":[{"id":25267,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/25266\/revisions\/25267"}],"wp:attachment":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/media?parent=25266"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/categories?post=25266"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/tags?post=25266"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}