{"id":14728,"date":"2024-07-04T09:36:02","date_gmt":"2024-07-04T01:36:02","guid":{"rendered":"https:\/\/www.1ai.net\/?p=14728"},"modified":"2024-07-04T09:36:16","modified_gmt":"2024-07-04T01:36:16","slug":"cloudflare-%e6%8e%a8%e5%87%ba%e4%b8%80%e9%94%ae%e9%98%bb%e6%ad%a2ai%e6%9c%ba%e5%99%a8%e4%ba%ba%e7%bd%91%e7%bb%9c%e7%88%ac%e8%99%ab%e7%9a%84%e6%96%b0%e6%96%b9%e6%b3%95","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/14728.html","title":{"rendered":"Cloudflare launches new way to block AI bots from crawling the web with one click"},"content":{"rendered":"<p><a href=\"https:\/\/www.1ai.net\/en\/tag\/cloudflare\" title=\"[See articles with [Claudflare] labels]\" target=\"_blank\" >Cloudflare<\/a> on Wednesday offered web hosting customers a way to block <a href=\"https:\/\/www.1ai.net\/en\/tag\/ai%e6%9c%ba%e5%99%a8%e4%ba%ba\" title=\"[SEES ARTICLES WITH LABELS]\" target=\"_blank\" >AI Robots<\/a>Methods of crawling website content and using the data without permission to train machine learning models.<\/p>\n<p>It is based on customers' distaste for AI bots and says that to help keep content creators safe on the internet, the company said in a statement.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-14729\" title=\"202304251756322709_5\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/07\/202304251756322709_5.jpg\" alt=\"202304251756322709_5\" width=\"654\" height=\"436\" \/><\/p>\n<p>Source Note: The image is generated by AI, and the image is authorized by Midjourney<\/p>\n<p>\"We've heard loud and clear that customers don't want AI bots accessing their sites, especially those that do so dishonestly. To help, we've added a new one-click block all AI bots feature.\"<\/p>\n<p>There is already a relatively effective way for website owners to block bots, and that is the widely available robots.txt file. When placed in the root directory of a website, the automatic<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e7%bd%91%e7%bb%9c%e7%88%ac%e8%99%ab\" title=\"[Sees articles with tags]\" target=\"_blank\" >Web crawler<\/a>Should notice and follow the instructions in the document telling them not to enter.<\/p>\n<p>Given the widespread belief that generative AI is based on theft and the many lawsuits attempting to hold AI companies accountable, companies engaged in \"scrubbing\" content generously allow web publishers to opt out of theft.<\/p>\n<p>Last August, OpenAI released guidance on how to block its GPTbot web crawler using the robots.txt directive, probably because it realized that people were concerned about content being crawled without permission and used for AI training without consent. Google took similar steps the following month. Also last September, Cloudflare began offering a way to block AI bots that follow the rules, with 85% customers reportedly enabling this blocking feature.<\/p>","protected":false},"excerpt":{"rendered":"<p>Cloudflare on Wednesday offered web hosting customers a way to stop AI bots from crawling website content and using the data to train machine learning models without permission. It's based on customers' distaste for AI bots and said to help keep content creators safe on the Internet, the company said in a statement. Image source note: Image generated by AI, image licensing provider Midjourney \"We've heard loud and clear that customers don't want AI bots accessing their sites, especially those that do so dishonestly. To help, we've added a brand new one-click block all AI bots feature.\" There's already a relatively effective way for website owners to block bots, and that's the widely available<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[393,3327,3328],"collection":[],"class_list":["post-14728","post","type-post","status-publish","format-standard","hentry","category-news","tag-ai","tag-cloudflare","tag-3328"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/14728","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=14728"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/14728\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=14728"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=14728"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=14728"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=14728"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}