{"id":13328,"date":"2017-01-23T04:21:36","date_gmt":"2017-01-23T04:21:36","guid":{"rendered":"http:\/\/www.kurzweilai.net\/?p=292334"},"modified":"2017-01-23T06:07:16","modified_gmt":"2017-01-23T06:07:16","slug":"ai-system-performs-better-than-75-percent-of-american-adults-on-standard-visual-intelligence-test","status":"publish","type":"post","link":"https:\/\/hoo.central12.com\/fugic\/2017\/01\/23\/ai-system-performs-better-than-75-percent-of-american-adults-on-standard-visual-intelligence-test\/","title":{"rendered":"AI system performs better than 75 percent of American adults on standard visual intelligence test"},"content":{"rendered":"<div id=\"attachment_292335\" class=\"wp-caption aligncenter\" style=\"width: 393px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><img class=\" wp-image-292335 noshadow \" title=\"Example Question from Raven's Test\" src=\"http:\/\/www.kurzweilai.net\/images\/Example-Question-from-Ravens-Test.jpg\" alt=\"\" width=\"383\" height=\"285\" \/><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">An example question from the Raven&#8217;s Progressive Matrices standardized fluid-intelligence test.* (credit: Ken Forbus)<\/p><\/div>\n<p>A Northwestern University team has developed a new visual problem-solving computational model that performs in the 75th percentile for American adults on a standard intelligence test.<\/p>\n<p>The research is an important step toward making artificial-intelligence systems that see and understand the world as humans do, says Northwestern Engineering\u2019s\u00a0<a title=\"More about Professor Forbus\" href=\"http:\/\/www.mccormick.northwestern.edu\/research-faculty\/directory\/profiles\/forbus-ken.html\" >Ken Forbus<\/a>,\u00a0Walter P. Murphy Professor of Electrical Engineering and Computer Science at Northwestern\u2019s McCormick School of Engineering. The research was published online in January 2017 in the journal\u00a0<a title=\"Visit the journal\" href=\"http:\/\/psycnet.apa.org\/journals\/rev\/124\/1\/60\/\" ><em>Psychological Review<\/em><\/a>.<\/p>\n<p>The new computational model** is built on\u00a0<a title=\"More about CogSketch\" href=\"http:\/\/spatiallearning.org\/index.php\/initiatives\/initiative-2-understand-tools\/tool-sketching\" >CogSketch<\/a>, an AI platform previously developed in Forbus\u2019 laboratory. It can solve visual problems and understand sketches to give immediate, interactive feedback. CogSketch also incorporates a computational model of analogy, based on Northwestern psychology professor Dedre Gentner\u2019s <a href=\"https:\/\/en.wikipedia.org\/wiki\/Structure_mapping_engine\" >structure-mapping engine<\/a>.<\/p>\n<p>The ability to solve complex visual problems is one of the hallmarks of human intelligence. Developing artificial intelligence systems that have this ability provides new evidence for the importance of symbolic representations and analogy in visual reasoning, and it could potentially shrink the gap between computer and human cognition, the researchers suggest.<\/p>\n<p><strong>A nonverbal fluid-intelligence test<\/strong><\/p>\n<p>The researchers tested the AI system on <a href=\"https:\/\/en.wikipedia.org\/wiki\/Raven's_Progressive_Matrices\" >Raven\u2019s Progressive Matrices<\/a>, a nonverbal standardized test that measures abstract reasoning.*** All of the test\u2019s problems consist of a matrix with one image missing. The test taker is given six to eight choices for completing the matrix.<\/p>\n<p>\u201cThe problems that are hard for people are also hard for the model, providing additional evidence that its operation is capturing some important properties of human cognition,\u201d said Forbus.<\/p>\n<p>\u201cThe Raven\u2019s test is the best existing predictor of what psychologists call \u2018fluid intelligence,&#8217; or the general ability to think abstractly, reason, identify patterns, solve problems, and discern relationships,\u201d said co-author Andrew Lovett, now a researcher at the U.S. Naval Research Laboratory. \u201cOur results suggest that the ability to flexibly use relational representations, comparing and reinterpreting them, is important for fluid intelligence.\u201d<\/p>\n<p>\u201cMost artificial intelligence research today concerning vision focuses on recognition, or labeling what is in a scene rather than reasoning about it,\u201d Forbus said. \u201cBut recognition is only useful if it supports subsequent reasoning. Our research provides an important step toward understanding visual reasoning more broadly.\u201d<\/p>\n<p><em>* The test taker should choose answer D because the relationships between it and the other elements in the bottom row are most similar to the relationships between the elements of the top rows.<\/em><\/p>\n<p><em>** &#8220;The reader may <a href=\"http:\/\/www.qrg.northwestern.edu\/software\/cogsketch\/CogSketch-v2023-ravens-64bit.zip\" >download<\/a> (Windows) the computational model and run it on example problems,&#8221; the authors note in their <\/em>Psychological Review<em> paper.<\/em><\/p>\n<p>** <em>Raven\u2019s Progressive Matrices (RPM) is an intelligence test that &#8220;requires that participants compare images in a (usually) 3&#215;3 matrix, identify a pattern across the matrix, and solve for the missing image.&#8221; &#8230; Designed to measure a subject\u2019s fluid intelligence, &#8220;it has remained popular for decades because it is highly successful at predicting a subject\u2019s performance on other ability tests \u2014 not just visual tests, but verbal and mathematical as well,&#8221; the authors suggest in their <\/em>Psychological Review<em> paper.<\/em><\/p>\n<hr \/>\n<p><strong>Abstract of\u00a0<em>Modeling visual problem solving as analogical reasoning<\/em><\/strong><\/p>\n<p>We present a computational model of visual problem solving, designed to solve problems from the Raven\u2019s Progressive Matrices intelligence test. The model builds on the claim that analogical reasoning lies at the heart of visual problem solving, and intelligence more broadly. Images are compared via structure mapping, aligning the common relational structure in 2 images to identify commonalities and differences. These commonalities or differences can themselves be reified and used as the input for future comparisons. When images fail to align, the model dynamically rerepresents them to facilitate the comparison. In our analysis, we find that the model matches adult human performance on the Standard Progressive Matrices test, and that problems which are difficult for the model are also difficult for people. Furthermore, we show that model operations involving abstraction and rerepresentation are particularly difficult for people, suggesting that these operations may be critical for performing visual problem solving, and reasoning more generally, at the highest level. (PsycINFO Database Record (c) 2016 APA, all rights reserved)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A Northwestern University team has developed a new visual problem-solving computational model that performs in the 75th percentile for American adults on a standard intelligence test. The research is an important step toward making artificial-intelligence systems that see and understand the world as humans do, says Northwestern Engineering&rsquo;s&nbsp;Ken Forbus,&nbsp;Walter P. Murphy Professor of Electrical Engineering [&#8230;]<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[46,43],"tags":[],"class_list":["post-13328","post","type-post","status-publish","format-standard","hentry","category-airobotics","category-news"],"_links":{"self":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/13328"}],"collection":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/comments?post=13328"}],"version-history":[{"count":2,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/13328\/revisions"}],"predecessor-version":[{"id":13330,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/13328\/revisions\/13330"}],"wp:attachment":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/media?parent=13328"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/categories?post=13328"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/tags?post=13328"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}