{"id":16996,"date":"2024-08-02T09:33:23","date_gmt":"2024-08-02T01:33:23","guid":{"rendered":"https:\/\/www.1ai.net\/?p=16996"},"modified":"2024-08-02T09:33:23","modified_gmt":"2024-08-02T01:33:23","slug":"openai%e6%89%bf%e8%af%ba%e5%90%91%e7%be%8e%e5%9b%bdai%e5%ae%89%e5%85%a8%e7%a0%94%e7%a9%b6%e6%89%80%e6%8f%90%e4%be%9b%e4%b8%8b%e4%b8%80%e4%b8%aaai%e6%a8%a1%e5%9e%8b%e6%97%a9%e6%9c%9f%e8%ae%bf%e9%97%ae","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/16996.html","title":{"rendered":"OpenAI pledges to give US AI Safety Institute early access to next AI model"},"content":{"rendered":"

recently,OpenAI<\/a> CEO Sam Altman revealed that OpenAI is working with an AI research group aimed at assessing and addressing risks in AI platforms.USA<\/a>The federal government is working with the National AI Safety Institute to provide it with early access to the next major generative AI model forSecurity Testing<\/a>.<\/p>\n

\"OpenAI<\/div>\n

The announcement, which Altman made Thursday evening at X, was light on details. But the move, along with a similar agreement reached in June with the U.K.\u2019s AI safety body, appears intended to counter the notion that OpenAI has relegated its AI safety work to the back burner as it pursues more powerful generative AI techniques.<\/p>\n

Previously, OpenAI effectively disbanded a division dedicated to developing controls to prevent \u201csuperintelligent\u201d AI systems from getting out of control in May. Reports indicate that OpenAI abandoned the team\u2019s safety research in favor of launching new products, which ultimately led to the resignation of the team\u2019s two co-leaders, Jan Lake (who now leads safety research at AI startup Anthropic) and OpenAI co-founder Ilya Sutskevi (who founded his own safety-focused AI company, Safe Superintelligence Inc.).<\/p>\n

Faced with growing criticism, OpenAI said it would remove the nondisparagement clause that restricted employees from reporting, set up a safety committee, and use 20% of computing resources for safety research. (The disbanded safety team had been promised 20% of OpenAI computing resources for work, but ultimately did not receive them.) Altman recommitted 20% of computing resources and confirmed that OpenAI abolished the nondisparagement clause for new and existing employees in May.<\/p>\n

However, the moves have failed to quell skepticism from some observers, especially after OpenAI made up its safety committee entirely of company insiders and recently reassigned a top AI safety executive to another department.<\/p>\n

Five senators, including Hawaii Democrat Brian Schatz, questioned OpenAI\u2019s policies in a recent letter to Altman. OpenAI Chief Strategy Officer Jason Kwon responded today to the letter, saying OpenAI is \u201ccommitted to implementing rigorous safety protocols at every stage of our process.\u201d<\/p>\n

The timing of OpenAI\u2019s agreement with the National AI Safety Institute seems a bit suspicious, given OpenAI\u2019s support for the Future of Innovation Act earlier this week. If passed, the bill would authorize the safety institute to set standards and guidelines for AI models as an administrative agency. This series of moves could be seen as an attempt to control regulation, or at least OpenAI\u2019s influence on AI policy making at the federal level.<\/p>\n

It is worth mentioning that Altman is a member of the U.S. Department of Homeland Security's Artificial Intelligence Safety and Security Commission, which provides advice on "safe and reliable development and deployment of AI" in critical U.S. infrastructure. Moreover, OpenAI's spending on federal lobbying has increased significantly this year, spending $800,000 in the first six months of 2024, compared to only $260,000 for the whole of 2023.<\/p>\n

The National AI Safety Institute is part of the Commerce Department\u2019s National Institute of Standards and Technology and is working with a coalition of companies including Anthropic and major tech companies including Google, Microsoft, Meta, Apple, Amazon and Nvidia.<\/p>","protected":false},"excerpt":{"rendered":"

Recently, OpenAI CEO Sam Altman revealed that OpenAI is working with the U.S. Institute for AI Security, a U.S. federal government agency that aims to assess and address the risks of AI platforms, to provide early access to the next major generative AI model to conduct security testing. Details are scarce on this announcement, which Altman made on X Thursday evening. But the move, along with a similar agreement with the U.K.'s AI security agency in June, seems intended to counter claims that OpenAI is putting AI security efforts on the back burner as it pursues more powerful generative AI technologies. The move comes after OpenAI in May effectively disbanded an organization dedicated to developing security measures against \"superintelligence\".<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[3831,190,3830,236],"collection":[],"class_list":["post-16996","post","type-post","status-publish","format-standard","hentry","category-news","tag-ai","tag-openai","tag-3830","tag-236"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16996","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=16996"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16996\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=16996"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=16996"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=16996"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=16996"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}