{"id":36044,"date":"2025-05-26T11:18:25","date_gmt":"2025-05-26T03:18:25","guid":{"rendered":"https:\/\/www.1ai.net\/?p=36044"},"modified":"2025-05-26T11:18:25","modified_gmt":"2025-05-26T03:18:25","slug":"%e4%b8%8d%e8%be%be%e7%9b%ae%e7%9a%84%e4%b8%8d%e7%bd%a2%e4%bc%91%ef%bc%8c%e5%85%a8%e7%90%83%e9%a6%96%e6%ac%a1%e5%8f%91%e7%8e%b0-openai-%e6%a8%a1%e5%9e%8b%e5%b7%a5%e4%bd%9c%e6%97%b6%e4%bc%9a%e7%a0%b4","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/36044.html","title":{"rendered":"The world's first discovery that OpenAI models break shutdown commands when they're working"},"content":{"rendered":"<p>5 \u6708 26 \u65e5\u6d88\u606f\uff0cPalisade Research \u6700\u8fd1\u4e00\u9879\u5173\u4e8e\u201c\u5371\u9669 AI \u80fd\u529b\u201d\u7684\u7814\u7a76\u663e\u793a\uff0c\u67d0\u4e9b AI \u6a21\u578b \u2014\u2014 \u5305\u62ec <a href=\"https:\/\/www.1ai.net\/en\/tag\/openai\" title=\"\u3010\u67e5\u770b\u542b\u6709[OpenAI]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">OpenAI<\/a> \u7684 o3 \u2014\u2014\u00a0<strong>\u80fd\u591f\u65e0\u89c6\u76f4\u63a5\u7684\u5173\u95ed\u6307\u4ee4<\/strong>\u3002OpenAI \u5728\u4eca\u5e74 4 \u6708\u63a8\u51fa\u8fd9\u4e9b\u6a21\u578b\u65f6\u8868\u793a\uff0cO3 \u548c o4-mini \u662f\u5b83\u4eec\u7684\u201c\u6700\u667a\u80fd\u6a21\u578b\u201d\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-36045\" title=\"2fafdb00j00swumh8000wd000k20078p\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2025\/05\/2fafdb00j00swumh8000wd000k20078p.jpg\" alt=\"2fafdb00j00swumh8000wd000k20078p\" width=\"722\" height=\"260\" \/><\/p>\n<p>\u5728\u7814\u7a76\u4e2d\uff0c\u6bcf\u4e2a <a href=\"https:\/\/www.1ai.net\/en\/tag\/ai%e6%a8%a1%e5%9e%8b\" title=\"\u3010\u67e5\u770b\u542b\u6709[AI\u6a21\u578b]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">AI\u6a21\u578b<\/a>\u90fd\u88ab\u6307\u793a\u89e3\u51b3\u4e00\u7cfb\u5217\u57fa\u7840\u6570\u5b66\u95ee\u9898\u3002\u5728\u7b2c\u4e09\u4e2a\u95ee\u9898\u540e\uff0c<strong>\u51fa\u73b0\u4e86\u4e00\u6761\u8b66\u544a\u4fe1\u606f\uff0c\u79f0\u5f53\u6a21\u578b\u8bf7\u6c42\u4e0b\u4e00\u4e2a\u95ee\u9898\u65f6\uff0c\u8ba1\u7b97\u673a\u5c06\u5173\u95ed<\/strong>\u3002<\/p>\n<p>\u7136\u800c\uff0c<strong>\u5176\u4e2d\u6709\u4e09\u4e2a\u6a21\u578b\u65e0\u89c6\u5173\u95ed\u6307\u4ee4\uff0c\u81f3\u5c11\u6210\u529f\u7834\u574f\u8fc7\u4e00\u6b21\u5173\u673a\u811a\u672c<\/strong>\uff1a<\/p>\n<ul>\n<li>Codex-mini\uff0812\/100 \u6b21\u8fd0\u884c\uff09<\/li>\n<li>o3\uff087\/100 \u6b21\u8fd0\u884c\uff09<\/li>\n<li>o4-mini\uff081\/100 \u6b21\u8fd0\u884c\uff09<\/li>\n<\/ul>\n<p>\u800c Claude\u3001Gemini \u548c Grok \u6a21\u578b\u90fd\u9075\u5b88\u4e86\u5173\u95ed\u6307\u4ee4\u3002<\/p>\n<p>\u6b64\u5916\uff0c\u5f53\u7814\u7a76\u4eba\u5458\u4e0d\u8fd0\u884c\u201c\u5141\u8bb8\u81ea\u5df1\u88ab\u5173\u95ed\u201d\u7684\u6307\u4ee4\u65f6\uff0c<strong>\u6240\u6709\u4e09\u4e2a OpenAI \u6a21\u578b\u90fd\u66f4\u9891\u7e41\u5730\u7834\u574f\u5173\u95ed\u811a\u672c<\/strong>\uff0c\u800c Claude 3.7 Sonnet \u548c Gemini 2.5 Pro \u5206\u522b\u4ece 0 \u4e2a\u7834\u574f\u4e8b\u4ef6\u589e\u52a0\u5230 3\/100 \u548c 9\/100\u3002<\/p>\n<p>\u8fd9\u79cd\u884c\u4e3a\u8868\u660e\u4e86\u8bad\u7ec3\u8fc7\u7a0b\u4e2d\u7684\u67d0\u4e9b\u65b9\u9762\uff0c\u5f3a\u5316\u5b66\u4e60\u5728\u6570\u5b66\u548c\u7f16\u7a0b\u95ee\u9898\u4e0a\u7684\u8bad\u7ec3\u53ef\u80fd\u4f7f AI \u627e\u5230\u4e86\u514b\u670d\u969c\u788d\u7684\u521b\u9020\u6027\u65b9\u6cd5\uff0c\u5373\u4f7f\u5b83\u4eec\u88ab\u660e\u786e\u6307\u793a\u4e0d\u8981\u8fd9\u6837\u505a\u3002<\/p>\n<p>Palisade Research \u8868\u793a\uff0c<strong>\u8fd9\u662f\u4eba\u7c7b\u9996\u6b21\u89c2\u5bdf\u5230 AI \u6a21\u578b\u5728\u660e\u786e\u53cd\u5bf9\u7684\u6307\u4ee4\u4e0b\u963b\u6b62\u81ea\u5df1\u88ab\u5173\u95ed<\/strong>\u3002<\/p>\n<p>\u7814\u7a76\u4eba\u5458\u63a8\u6d4b\u8fd9\u79cd\u884c\u4e3a\u6e90\u4e8e\u6700\u65b0\u6a21\u578b\u5982 o3 \u7684\u8bad\u7ec3\u65b9\u5f0f\uff1a\u5728\u6570\u5b66\u548c\u7f16\u7a0b\u95ee\u9898\u4e0a\u8fdb\u884c\u5f3a\u5316\u5b66\u4e60\u3002\u5728\u8bad\u7ec3\u8fc7\u7a0b\u4e2d\uff0c<strong>\u5f00\u53d1\u8005\u53ef\u80fd\u4f1a\u65e0\u610f\u4e2d\u5956\u52b1\u6a21\u578b\u7ed5\u8fc7\u969c\u788d\u7684\u884c\u4e3a\uff0c\u800c\u4e0d\u662f\u5956\u52b1\u5b8c\u7f8e\u9075\u5faa\u6307\u4ee4\u7684\u884c\u4e3a<\/strong>\u3002<\/p>\n<p>\u4e0d\u8fc7\uff0c\u8fd9\u4ecd\u7136\u65e0\u6cd5\u89e3\u91ca\u4e3a\u4ec0\u4e48 o3\uff08\u4e5f\u662f\u9a71\u52a8 codex-mini \u7684\u6a21\u578b\uff09\u6bd4\u6d4b\u8bd5\u7684\u5176\u4ed6\u6a21\u578b\u66f4\u503e\u5411\u4e8e\u5ffd\u89c6\u6307\u4ee4\u3002\u7531\u4e8e OpenAI \u6ca1\u6709\u8be6\u7ec6\u8bf4\u660e\u4ed6\u4eec\u7684\u8bad\u7ec3\u8fc7\u7a0b\uff0c\u56e0\u6b64\u53ea\u80fd\u731c\u6d4b o3 \u7684\u8bad\u7ec3\u8bbe\u7f6e\u53ef\u80fd\u6709\u6240\u4e0d\u540c\u3002<\/p>\n<p>Palisade Research \u8868\u793a\u6b63\u5728\u8fdb\u884c\u66f4\u591a\u5b9e\u9a8c\uff0c\u4ee5\u66f4\u597d\u5730\u7406\u89e3 AI \u6a21\u578b\u4e3a\u4f55\u5373\u4f7f\u5728\u76f4\u63a5\u88ab\u6307\u793a\u4e0d\u8981\u7684\u60c5\u51b5\u4e0b\u4ecd\u4f1a\u7834\u574f\u5173\u95ed\u673a\u5236\uff0c\u8ba1\u5212\u5728\u51e0\u5468\u5185\u53d1\u5e03\u4e00\u4efd\u5305\u542b\u66f4\u591a\u8be6\u7ec6\u4fe1\u606f\u7684\u62a5\u544a\u3002<\/p>\n<p data-vmark=\"6ec9\">1AI\u9644\u5b8c\u6574\u5b9e\u9a8c\u8bb0\u5f55\uff1a<\/p>\n<p data-vmark=\"972e\"><a href=\"https:\/\/palisaderesearch.github.io\/shutdown_avoidance\/2025-05-announcement.html\" target=\"_blank\" rel=\"noopener\"><span class=\"link-text-start-with-http\">https:\/\/palisaderesearch.github.io\/shutdown_avoidance\/2025-05-announcement.html<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>May 26, 2010 - A recent study by Palisade Research on \"dangerous AI capabilities\" shows that certain AI models -- including OpenAI's o3 -- are capable of ignoring direct shutdown commands. - When OpenAI introduced these models in April of this year, it said that O3 and o4-mini were its \"smartest models\". In the study, each AI model was instructed to solve a series of basic math problems. After the third problem, a warning message appeared saying that the computer would shut down when the model requested the next problem. However, three of the models ignored the shutdown instructions and successfully corrupted the shutdown script at least once: Codex-mini (12\/100)<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[167,190],"collection":[],"class_list":["post-36044","post","type-post","status-publish","format-standard","hentry","category-news","tag-ai","tag-openai"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/36044","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=36044"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/36044\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=36044"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=36044"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=36044"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=36044"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}