{"id":2915,"date":"2015-10-29T05:59:45","date_gmt":"2015-10-29T05:59:45","guid":{"rendered":"http:\/\/www.kurzweilai.net\/?p=265556"},"modified":"2015-10-30T06:52:57","modified_gmt":"2015-10-30T06:52:57","slug":"what-happens-in-the-brain-when-we-learn","status":"publish","type":"post","link":"https:\/\/hoo.central12.com\/fugic\/2015\/10\/29\/what-happens-in-the-brain-when-we-learn\/","title":{"rendered":"What happens in the brain when we learn"},"content":{"rendered":"<div id=\"attachment_265627\" class=\"wp-caption aligncenter\" style=\"width: 610px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><a href=\"http:\/\/www.kurzweilai.net\/what-happens-in-the-brain-when-we-learn\/eligibility-trace-2\" rel=\"attachment wp-att-265627\"><img class=\" wp-image-265627\" title=\"Eligibility Trace\" src=\"http:\/\/www.kurzweilai.net\/images\/Eligibility-Trace1.jpg\" alt=\"\" width=\"600\" height=\"432\" \/><\/a><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">Isolated cells in the visual cortex of a mouse (credit: Alfredo\/Kirkwood (JHU))<\/p><\/div>\n<p>A <a href=\"https:\/\/www.jhu.edu\/\" >Johns Hopkins University<\/a>-led research team has proven a working theory that explains what happens in the brain when we learn, as described in the current issue of the journal\u00a0<a href=\"http:\/\/www.cell.com\/neuron\/abstract\/S0896-6273%2815%2900826-0\" ><em>Neuron<\/em><\/a>.<\/p>\n<p>More than a century ago, Pavlov figured out that dogs fed after hearing a bell eventually began to salivate when they heard the bell ring. The team looked into the question of how <a href=\"https:\/\/en.wikipedia.org\/wiki\/Classical_conditioning\" >Pavlov\u2019s dogs<\/a> (in &#8220;classical conditioning&#8221;) managed to associate an action with a delayed reward to create knowledge. For decades, scientists had a working theory of how it happened, but the team is now the first to prove it.<\/p>\n<p>\u201cIf you\u2019re trying to train a dog to sit, the initial neural stimuli, the command, is gone almost instantly &#8212; it lasts as long as the word sit,\u201d said neuroscientist\u00a0<a href=\"http:\/\/krieger.jhu.edu\/mbi\/research\/Kirkwood\/index.html\" >Alfredo Kirkwood<\/a>, a professor with the university\u2019s\u00a0<a href=\"http:\/\/krieger.jhu.edu\/mbi\/\" >Zanvyl Krieger Mind\/Brain Institute<\/a>. \u201cBefore the reward comes, the dog\u2019s brain has already turned to other things. The mystery was, \u2018How does the brain link an action that\u2019s over in a fraction of a second with a reward that doesn\u2019t come until much later?\u2019 \u201d<\/p>\n<p><strong>Eligibility traces<br \/>\n<\/strong><\/p>\n<p>The working theory &#8212; which Kirkwood\u2019s team has now validated\u00a0experimentally &#8212; is that invisible \u201csynaptic eligibility traces\u201d effectively tag the synapses activated by the stimuli so that the learning can be cemented with the arrival of a reward. The reward is a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Neuromodulation\" >neuromodulator<\/a>* (neurochemical) that<em> <\/em>floods the dog\u2019s brain with \u201cgood feelings.\u201d Though the brain has long since processed the &#8220;sit&#8221; command, eligibility traces in the synapse respond to the neuromodulators, prompting a lasting synaptic change, a.k.a. &#8220;learning.&#8221;<\/p>\n<p>The team was able to prove the eligibility-traces theory by isolating cells in the visual cortex of a mouse. When they stimulated the axon of one cell with an electrical impulse, they sparked a response in another cell. By doing this repeatedly, they mimicked the synaptic response between two cells as they process a stimulus and create an eligibility trace.<\/p>\n<p>When the researchers later flooded the cells with neuromodulators, simulating the arrival of a delayed reward, the response between the cells strengthened (&#8220;long-term potentiation&#8221;) or weakened (&#8220;long-term depression&#8221;), showing that the cells had \u201clearned\u201d and were able to do so because of the eligibility trace.<\/p>\n<p>\u201cThis is the basis of how we learn things through reward,\u201d Kirkwood said, \u201ca fundamental aspect of learning.\u201d<\/p>\n<p>In addition to a greater understanding of the mechanics of learning, these findings could enhance teaching methods and lead to treatments for cognitive problems, the researchers suggest.<\/p>\n<p>Scientists at the University of Texas at Houston and the University of California, Davis were also involved in the research, which was supported by grants from JHU&#8217;s\u00a0<a href=\"http:\/\/scienceoflearning.jhu.edu\/\">Science of Learning Institute<\/a>\u00a0and National Institutes of Health.<\/p>\n<p><em>* The neuromodulators tested were norepinephrine, serotonin, dopamine, and acetylcholine, all of which have been implicated in cortical plasticity (ability to grow and form new connections to other neurons).<\/em><\/p>\n<hr \/>\n<p><strong>Abstract of\u00a0<em>Distinct Eligibility Traces for LTP and LTD in Cortical Synapses<\/em><\/strong><\/p>\n<p>In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated \u201csynaptic eligibility traces,\u201d silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of\u00a0distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A Johns Hopkins University-led research team has proven a working theory that explains what happens in the brain when we learn, as described in the current issue of the journal&nbsp;Neuron. More than a century ago, Pavlov figured out that dogs fed after hearing a bell eventually began to salivate when they heard the bell ring. [&#8230;]<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49,43],"tags":[],"class_list":["post-2915","post","type-post","status-publish","format-standard","hentry","category-cognitive-scienceneuroscience","category-news"],"_links":{"self":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/2915"}],"collection":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/comments?post=2915"}],"version-history":[{"count":3,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/2915\/revisions"}],"predecessor-version":[{"id":2988,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/2915\/revisions\/2988"}],"wp:attachment":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/media?parent=2915"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/categories?post=2915"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/tags?post=2915"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}