{"id":7755,"date":"2016-05-18T06:34:48","date_gmt":"2016-05-18T06:34:48","guid":{"rendered":"http:\/\/www.kurzweilai.net\/?p=280481"},"modified":"2016-05-19T06:36:29","modified_gmt":"2016-05-19T06:36:29","slug":"using-animal-training-techniques-to-teach-robots-household-chores","status":"publish","type":"post","link":"https:\/\/hoo.central12.com\/fugic\/2016\/05\/18\/using-animal-training-techniques-to-teach-robots-household-chores\/","title":{"rendered":"Using animal training techniques to teach robots household chores"},"content":{"rendered":"<div id=\"attachment_280482\" class=\"wp-caption aligncenter\" style=\"width: 380px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-280482 \" title=\"robot-training\" src=\"http:\/\/www.kurzweilai.net\/images\/robot-training.jpg\" alt=\"\" width=\"370\" height=\"301\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">Virtual environments for training a robot dog (credit: Washington State University)<\/p><\/div>\n<p>Researchers at <a href=\"https:\/\/wsu.edu\/\" >Washington State University<\/a> are using ideas from animal training to help non-expert users teach robots how to do desired tasks.<\/p>\n<p>As robots become more pervasive in society, humans will want them to do chores like cleaning house or cooking. But to get a robot started on a task, people who aren\u2019t computer programmers will have to give it instructions. \u201cSo we needed to provide a way for everyone to train robots, without programming,\u201d said <a href=\"http:\/\/eecs.wsu.edu\/~taylorm\/\" >Matthew Taylor<\/a>, Allred Distinguished Professor in the WSU School of Electrical Engineering and Computer Science.<\/p>\n<p><strong>User feedback improves robot performance<\/strong><\/p>\n<p>With Bei Peng, a doctoral student in computer science, and collaborators at Brown University and North Carolina State University, Taylor designed a computer program that lets humans without programming expertise teach a virtual robot that resembles a dog in <a href=\"http:\/\/irll.eecs.wsu.edu\/\" >WSU\u2019s Intelligent Robot Learning Laboratory<\/a>.<\/p>\n<p>For the study, the researchers varied the speed at which their virtual dog reacted. As when somebody is teaching a new skill to a real animal, the slower movements let the trainer know that the virtual dog was unsure of how to behave, so trainers could provide clearer guidance to help the robot learn better.<\/p>\n<p>The researchers have begun working with physical robots as well as virtual ones. They also hope to eventually also use the program to help people learn to be more effective animal trainers.<\/p>\n<p>The researchers recently presented their work at the international Autonomous Agents and Multiagent Systems conference, a scientific gathering for agents and robotics research. Funding for the project came from a National Science Foundation grant.<\/p>\n<p><iframe frameborder=\"0\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/AJQSGD_XPrk?rel=0\" width=\"640\"><\/iframe><br \/>\n<em> Bei Peng\/WSU | Dog Training &#8212; AAMAS 2016<\/em><\/p>\n<hr \/>\n<p><strong>Abstract of <em>A Need for Speed: Adapting Agent Action Speed to Improve Task Learning from Non-Expert Humans<\/em><\/strong><\/p>\n<p>As robots become pervasive in human environments, it is important to enable users to effectively convey new skills without programming. Most existing work on Interactive Reinforcement Learning focuses on interpreting and incorporating non-expert human feedback to speed up learning; we aim to design a better representation of the learning agent that is able to elicit more natural and effective communication between the human trainer and the learner, while treating human feedback as discrete communication that depends probabilistically on the trainer\u2019s target policy. This work entails a user study where participants train a virtual agent to accomplish tasks by giving reward and\/or punishment in a variety of simulated environments. We present results from 60 participants to show how a learner can ground natural language commands and adapt its action execution speed to learn more efficiently from human trainers. The agent\u2019s action execution speed can be successfully modulated to encourage more explicit feedback from a human trainer in areas of the state space where there is high uncertainty. Our results show that our novel adaptive speed agent dominates different fixed speed agents on several measures of performance. Additionally, we investigate the impact of instructions on user performance and user preference in training conditions.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Researchers at Washington State University are using ideas from animal training to help non-expert users teach robots how to do desired tasks. As robots become more pervasive in society, humans will want them to do chores like cleaning house or cooking. But to get a robot started on a task, people who aren&rsquo;t computer programmers [&#8230;]<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[46,43],"tags":[],"class_list":["post-7755","post","type-post","status-publish","format-standard","hentry","category-airobotics","category-news"],"_links":{"self":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/7755"}],"collection":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/comments?post=7755"}],"version-history":[{"count":1,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/7755\/revisions"}],"predecessor-version":[{"id":7756,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/7755\/revisions\/7756"}],"wp:attachment":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/media?parent=7755"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/categories?post=7755"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/tags?post=7755"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}