{"id":25198,"date":"2018-06-26T22:38:36","date_gmt":"2018-06-26T22:38:36","guid":{"rendered":"http:\/\/www.kurzweilai.net\/?p=317911"},"modified":"2018-06-29T19:22:07","modified_gmt":"2018-06-29T19:22:07","slug":"spotting-fake-images-with-ai","status":"publish","type":"post","link":"https:\/\/hoo.central12.com\/fugic\/2018\/06\/26\/spotting-fake-images-with-ai\/","title":{"rendered":"Spotting fake images with AI"},"content":{"rendered":"<div id=\"attachment_317912\" class=\"wp-caption aligncenter\" style=\"width: 632px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;\"><a href=\"http:\/\/www.kurzweilai.net\/spotting-fake-images-with-ai\/tampered-image\" rel=\"attachment wp-att-317912\"><img class=\" wp-image-317912\" title=\"tampered image\" src=\"http:\/\/www.kurzweilai.net\/images\/tampered-image.png\" alt=\"\" width=\"622\" height=\"221\" \/><\/a><p style=' padding: 0 4px 5px; margin: 0;'  class=\"wp-caption-text\">This tampered image (left) can be detected by noting visual artifacts (red rectangle, showing the unnaturally high contrast along the baseball player\u2019s edges), compared to authentic regions (the parking lot background); and by noting noise pattern inconsistencies between the tampered regions and the background (as seen in \u201cNoise\u201d image). The \u201cground-truth\u201d image is the outline of the added (fake) image used in the experiment. (credit: Adobe)<\/p><\/div>\n<p>Thanks to user-friendly image editing software like <a href=\"https:\/\/www.adobe.com\/products\/photoshop.html\" >Adobe Photoshop<\/a>, it\u2019s becoming increasingly difficult and time-consuming to spot some deceptive image manipulations.<\/p>\n<p>Now, funded by DARPA, researchers at Adobe and the University of Maryland, College Park have turned to AI to detect the more subtle methods now used in doctoring images.<\/p>\n<p><strong>Forensic AI<\/strong><\/p>\n<p>What used to take an image-forensic expert several hours to do can now be done in seconds with AI, says Vlad Morariu, PhD, a senior research scientist at Adobe. \u201cUsing tens of thousands of examples of known, manipulated images, we successfully trained a deep learning neural network* to recognize image manipulation in each image,\u201d he explains.<\/p>\n<p>\u201cWe focused on three common tampering techniques &#8212; <em>splicing<\/em>, where parts of two different images are combined;\u00a0<em>copy-move<\/em>, where objects in a photograph are moved or cloned from one place to another; and\u00a0<em>removal<\/em>, where an object is removed from a photograph, and filled-in,\u201d he notes.<\/p>\n<p>The neural network looks for two things: changes to the red, green and blue color values of pixels; and inconsistencies in the random variations of color and brightness generated by a camera&#8217;s sensor or by later software manipulations, such as\u00a0<a href=\"https:\/\/en.wikipedia.org\/wiki\/Gaussian_blur\" >Gaussian smoothing<\/a>.<\/p>\n<p><iframe frameborder=\"0\" height=\"351\" src=\"https:\/\/www.youtube.com\/embed\/7e5Q0TgPR54\" width=\"623\"><\/iframe><\/p>\n<p><em>Ref: <\/em><a href=\"http:\/\/openaccess.thecvf.com\/content_cvpr_2018\/papers\/Zhou_Learning_Rich_Features_CVPR_2018_paper.pdf\">2018 Computer Vision and Pattern Recognition Proceedings<\/a><em> (open access). Source: <a href=\"https:\/\/theblog.adobe.com\/spotting-image-manipulation-ai\">Adobe Blog<\/a>.<\/em><\/p>\n<p><em>* The researchers used a <\/em><em>\u201ctwo-stream Faster R-CNN\u201d (a type of <a href=\"https:\/\/en.wikipedia.org\/wiki\/Convolutional_neural_network\">convolutional neural network<\/a>) that they trained end-to-end to detect the tampered regions in a manipulated image. The two streams are RGB (red-green-blue &#8212; the millions of different colors) to find tampering artifacts like strong contrast difference and unnatural tampered boundaries; and noise (inconsistency of noise patterns between authentic and tampered regions &#8212; in the example above, note that the baseball player&#8217;s image is lighter, for example, in addition to more-subtle differences that can be detected by the algorithm &#8212; even what tampering technique was used). These two features are then fused together to further identify spatial co-occurrence of these two modalities (RGB and noise).<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Thanks to user-friendly image editing software like Adobe Photoshop, it&rsquo;s becoming increasingly difficult and time-consuming to spot some deceptive image manipulations. Now, funded by DARPA, researchers at Adobe and the University of Maryland, College Park have turned to AI to detect the more subtle methods now used in doctoring images. Forensic AI What used to [&#8230;]<\/p>\n","protected":false},"author":454,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[46,43,54],"tags":[],"class_list":["post-25198","post","type-post","status-publish","format-standard","hentry","category-airobotics","category-news","category-vraugmented-realitycomputer-graphics"],"_links":{"self":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/25198"}],"collection":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/users\/454"}],"replies":[{"embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/comments?post=25198"}],"version-history":[{"count":1,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/25198\/revisions"}],"predecessor-version":[{"id":25199,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/posts\/25198\/revisions\/25199"}],"wp:attachment":[{"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/media?parent=25198"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/categories?post=25198"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hoo.central12.com\/fugic\/wp-json\/wp\/v2\/tags?post=25198"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}