{"id":16456,"date":"2024-07-26T09:18:19","date_gmt":"2024-07-26T01:18:19","guid":{"rendered":"https:\/\/www.1ai.net\/?p=16456"},"modified":"2024-07-26T09:18:19","modified_gmt":"2024-07-26T01:18:19","slug":"reddit-%e8%a2%ab%e6%9b%9d%e5%b1%8f%e8%94%bd%e5%a4%9a%e4%b8%aa%e6%90%9c%e7%b4%a2%e5%bc%95%e6%93%8e%e5%92%8c-ai-%e7%88%ac%e8%99%ab%ef%bc%8c%e5%ae%98%e6%96%b9%e7%a7%b0%e4%b8%8e%e8%b0%b7%e6%ad%8c%e5%90%88","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/16456.html","title":{"rendered":"Reddit was reported to have blocked multiple search engines and AI crawlers, and the official said it had nothing to do with the cooperation with Google"},"content":{"rendered":"<p data-vmark=\"853b\">In February this year,<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e8%b0%b7%e6%ad%8c\" title=\"[View articles tagged with [Google]]\" target=\"_blank\" >Google<\/a>Announced with <a href=\"https:\/\/www.1ai.net\/en\/tag\/reddit\" title=\"_Other Organiser\" target=\"_blank\" >Reddit<\/a> A new agreement was reached.<strong>Reddit data will be used to train Google&#039;s <a href=\"https:\/\/www.1ai.net\/en\/tag\/ai%e6%a8%a1%e5%9e%8b\" title=\"[View articles tagged with [AI models]]\" target=\"_blank\" >AI Models<\/a><\/strong>, and highlighted Reddit results in Google search results. Bloomberg reported that the deal was for about $60 million. Since then, Reddit&#039;s presence in Google searches has also increased significantly.<\/p>\n<p data-vmark=\"4eb2\">The latest news says that<strong>Reddit has banned other search engines from indexing its content<\/strong>404 Media first reported the move, noting that Reddit had updated its\u00a0<span class=\"link-text-start-with-http\">robots.txt<\/span> File (the protocol file between the website and the crawler) prevents all robots from crawling any content of the website.<\/p>\n<p data-vmark=\"d68b\">Query Reddit&#039;s <span class=\"link-text-start-with-http\">robots.txt<\/span>\u00a0The platform said, \u201cReddit believes in an open internet, but not in the abuse of public content,\u201d the document learned.<strong>Its &quot;Disallow&quot; option is set to &quot;\/&quot;<\/strong>, which means that all files under the root directory of the website are prohibited from being retrieved.<\/p>\n<p data-vmark=\"8042\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-16457\" title=\"b8555e6e-7f7e-44aa-b4b7-84da8c80aa0a\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/07\/b8555e6e-7f7e-44aa-b4b7-84da8c80aa0a.png\" alt=\"b8555e6e-7f7e-44aa-b4b7-84da8c80aa0a\" width=\"625\" height=\"366\" \/><\/p>\n<p data-vmark=\"3b28\">The document was first updated in June of this year, with Reddit explaining that the change was due to &quot;a significant increase in commercial entities scraping Reddit content and the abuse of that content.&quot;<\/p>\n<p data-vmark=\"6bd6\">Foreign media 9To5Google said,<strong>Search engines such as Bing, DuckDuckGo, Mojeek and Qwant were affected<\/strong>, use &quot;site:<span class=\"link-text-start-with-http\">reddit.com<\/span>\u201d When searching for content, either the latest content is not displayed or the complete website results are not displayed.<\/p>\n<p data-vmark=\"d022\">However, the latest test<strong>Bing and DuckDuckGo have re-displayed \u201csite:<span class=\"link-text-start-with-http\">reddit.com<\/span>&quot;Search content<\/strong>.<\/p>\n<p data-vmark=\"4b4c\">Reddit spokesperson Tim Rathschmidt said in a statement to The Verge:<strong>This is completely unrelated to our recent partnership with Google.<\/strong>We have been in discussions with multiple search engines but have been unable to reach agreement with all of them because some have been unable or unwilling to make enforceable commitments regarding their use of Reddit content, including their use of AI training.\u201d<\/p>","protected":false},"excerpt":{"rendered":"<p>In February, Google announced a new deal with Reddit that will see Reddit data used to train Google's AI models and highlight Reddit results in Google search results. Bloomberg reported that the deal was worth about $60 million. Since then, Reddit's display in Google search has also increased dramatically. The latest news is that Reddit has banned other search engines from retrieving content from its site. 404 Media was the first to report on this behavior, noting that Reddit has updated its robots.txt file (the site's protocol file for crawlers) to prevent all bots from crawling any of the site's content. Check the ro<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[167,1269,281],"collection":[],"class_list":["post-16456","post","type-post","status-publish","format-standard","hentry","category-news","tag-ai","tag-reddit","tag-281"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16456","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=16456"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16456\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=16456"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=16456"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=16456"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=16456"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}