{"id":15298,"date":"2017-04-20T02:10:03","date_gmt":"2017-04-20T02:10:03","guid":{"rendered":"http:\/\/www.kurzweilai.net\/?p=299586"},"modified":"2017-04-22T21:22:37","modified_gmt":"2017-04-22T21:22:37","slug":"what-if-you-could-type-directly-from-your-brain-at-100-words-per-minute","status":"publish","type":"post","link":"https:\/\/hoo.central12.com\/fugic\/2017\/04\/20\/what-if-you-could-type-directly-from-your-brain-at-100-words-per-minute\/","title":{"rendered":"What if you could type directly from your brain at 100 words per minute?"},"content":{"rendered":"<div id=\"attachment_299592\" class=\"wp-caption aligncenter\" style=\"width: 475px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-299592\" title=\"Dugan at F8\" src=\"http:\/\/www.kurzweilai.net\/images\/Dugan-at-F8.png\" alt=\"\" width=\"465\" height=\"224\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">(credit: Facebook)<\/p><\/div>\n<p>Regina Dugan, PhD, Facebook VP of Engineering, Building8, <a href=\"https:\/\/developers.facebook.com\/videos\/f8-2017\/f8-2017-keynote-day-2\/\" >revealed<\/a> today (April 19, 2017) at\u00a0<a href=\"http:\/\/www.theverge.com\/2017\/4\/18\/15344950\/facebook-f8-developer-conference-news-2017\" >Facebook F8 conference 2017<\/a> a plan to develop a non-invasive brain-computer interface that will let you type at 100 wpm &#8212; by decoding neural activity devoted to speech.<\/p>\n<p>Dugan previously headed Google&#8217;s\u00a0Advanced Technology and Projects Group, and before that, was Director of the Defense Advanced Research Projects Agency (DARPA).<\/p>\n<p>She explained in a Facebook post that over the next two years, her team will be building systems that demonstrate &#8220;a non-invasive system that could one day become a speech prosthetic for people with communication disorders or a new means for input to AR [augmented reality].&#8221;<\/p>\n<p>Dugan said that &#8220;even something as simple as a \u2018yes\/no\u2019 brain click &#8230; would be transformative.&#8221; That simple level has been achieved by using functional near-infrared spectroscopy (<em>f<\/em>NIRS) to measure changes in blood oxygen levels in the frontal lobes of the brain, as <em>KurzweilAI<\/em> recently <a href=\"http:\/\/www.kurzweilai.net\/brain-computer-interface-enables-completely-locked-in-patients-to-communicate-for-the-first-time\" >reported<\/a>. (Near-infrared light can penetrate the skull and partially into the brain.)<\/p>\n<p>Dugan agrees that optical imaging is the best place to start, but her Building8 team team plans to go way beyond that research &#8212; sampling hundreds of times per second and precise to millimeters. The research team began working on the brain-typing project six months ago and she now has a team of more than 60 researchers who specialize in optical neural imaging systems that push the limits of spatial resolution and machine-learning methods for decoding speech and language.<\/p>\n<p>The research is headed by <a href=\"https:\/\/www.linkedin.com\/in\/mark-chevillet-971a001b\" >Mark Chevillet<\/a>,\u00a0previously an adjunct professor of neuroscience at Johns Hopkins University.<\/p>\n<p>Besides replacing smartphones, the system would be a powerful speech prosthetic, she noted &#8212; allowing paralyzed patients to &#8220;speak&#8221; at normal speed.<\/p>\n<div id=\"attachment_299596\" class=\"wp-caption aligncenter\" style=\"width: 476px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-299596\" title=\"quasi ballistic photons\" src=\"http:\/\/www.kurzweilai.net\/images\/quasi-ballistic-photons.png\" alt=\"\" width=\"466\" height=\"132\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">(credit: Facebook)<\/p><\/div>\n<p>Dugan revealed one specific method the researchers are currently working on to achieve that: a ballistic filter for creating quasi ballistic photons (avoiding diffusion) &#8212; creating a narrow beam for precise targeting &#8212; combined with a new method of detecting blood-oxygen levels.<\/p>\n<div id=\"attachment_299597\" class=\"wp-caption aligncenter\" style=\"width: 478px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-299597\" title=\"word detection\" src=\"http:\/\/www.kurzweilai.net\/images\/word-detection.png\" alt=\"\" width=\"468\" height=\"176\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">Neural activity (in green) and associated blood oxygenation level dependent (BOLD) waveform (credit: Facebook)<\/p><\/div>\n<p>Dugan also described a system that may one day allow hearing-impaired people to hear directly via vibrotactile sensors embedded in the skin. &#8220;In the 19th century, Braille taught us that we could interpret small bumps on a surface as language,&#8221; she said. &#8220;Since then, many techniques have emerged that illustrate our brain\u2019s ability to reconstruct language from components.&#8221; Today, she demonstrated &#8220;an artificial cochlea of sorts and the beginnings of a new a \u2018haptic vocabulary\u2019.&#8221;<\/p>\n<div id=\"attachment_299600\" class=\"wp-caption aligncenter\" style=\"width: 478px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-299600\" title=\"acoustic shape\" src=\"http:\/\/www.kurzweilai.net\/images\/acoustic-shape.png\" alt=\"\" width=\"468\" height=\"262\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">A Facebook engineer with acoustic sensors implanted in her arm has learned to feel the acoustic shapes corresponding to words (credit: Facebook)<\/p><\/div>\n<p>Dugan&#8217;s presentation can be viewed in the\u00a0<a href=\"https:\/\/developers.facebook.com\/videos\/f8-2017\/f8-2017-keynote-day-2\/\">F8 2017 Keynote Day 2 video<\/a> (starting at 1:08:10).<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<div>\n<p>&nbsp;<\/p>\n<div id=\"attachment_299587\" class=\"wp-caption aligncenter\" style=\"width: 464px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-299587\" title=\"Facebook 10-year roadmap\" src=\"http:\/\/www.kurzweilai.net\/images\/Facebook-10-year-roadmap.jpg\" alt=\"\" width=\"454\" height=\"193\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">(credit: Facebook)<\/p><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Regina Dugan, PhD, Facebook VP of Engineering, Building8, revealed today (April 19, 2017) at&nbsp;Facebook F8 conference 2017 a plan to develop a non-invasive brain-computer interface that will let you type at 100 wpm &mdash; by decoding neural activity devoted to speech. Dugan previously headed Google&rsquo;s&nbsp;Advanced Technology and Projects Group, and before that, was Director of [&#8230;]<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49,48,43],"tags":[],"class_list":["post-15298","post","type-post","status-publish","format-standard","hentry","category-cognitive-scienceneuroscience","category-electronics","category-news"],"_links":{"self":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/15298"}],"collection":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/comments?post=15298"}],"version-history":[{"count":3,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/15298\/revisions"}],"predecessor-version":[{"id":15377,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/15298\/revisions\/15377"}],"wp:attachment":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/media?parent=15298"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/categories?post=15298"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/tags?post=15298"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}