{"id":5412,"date":"2024-03-13T09:32:37","date_gmt":"2024-03-13T01:32:37","guid":{"rendered":"https:\/\/www.1ai.net\/?p=5412"},"modified":"2024-03-13T09:32:37","modified_gmt":"2024-03-13T01:32:37","slug":"%e8%b0%b7%e6%ad%8c%e7%aa%83%e5%8f%96gpt-3-5%e6%a8%a1%e5%9e%8b%e5%85%b3%e9%94%ae%e4%bf%a1%e6%81%af%e6%88%90%e6%9c%ac%e4%bd%8e%e8%87%b3150%e5%85%83%ef%bc%8c%e8%b0%83%e7%94%a8api","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/5412.html","title":{"rendered":"Google &quot;stole&quot; key information of GPT-3.5 model: the cost is as low as 150 yuan, and you can get it by calling API"},"content":{"rendered":"<p><a href=\"https:\/\/www.1ai.net\/en\/tag\/%e8%b0%b7%e6%ad%8c\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u8c37\u6b4c]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u8c37\u6b4c<\/a><span class=\"spamTxt\">\u6700\u65b0<\/span>\u7814\u7a76\u63ed\u793a\u4e86\u4e00\u79cd\u653b\u51fb<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%a4%a7%e5%9e%8b%e8%af%ad%e8%a8%80%e6%a8%a1%e5%9e%8b\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u5927\u578b\u8bed\u8a00\u6a21\u578b]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u5927\u578b\u8bed\u8a00\u6a21\u578b<\/a>\u7684\u65b9\u6cd5\uff0c\u6210\u529f\u7a83\u53d6\u4e86OpenAI GPT-3.5-turbo\u6a21\u578b\u7684\u5173\u952e\u4fe1\u606f\u3002\u6839\u636e\u8c37\u6b4c\u7684\u58f0\u660e\uff0c\u4ed6\u4eec\u4e0d\u4ec5\u8fd8\u539f\u4e86OpenAI\u5927\u6a21\u578b\u7684\u6574\u4e2a\u6295\u5f71\u77e9\u9635\uff0c\u8fd8\u83b7\u5f97\u4e86\u786e\u5207\u7684\u9690\u85cf\u7ef4\u5ea6\u5927\u5c0f\uff0c\u800c\u8fd9\u4e00\u5207\u53ea\u9700\u4e0d\u52302000\u6b21\u5de7\u5999\u7684<a href=\"https:\/\/www.1ai.net\/en\/tag\/api\" title=\"\u3010\u67e5\u770b\u542b\u6709[API]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">API<\/a>\u67e5\u8be2\uff0c\u6210\u672c\u4f4e\u81f3150\u5143\u3002<\/p>\n<p class=\"article-content__img\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-5413\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/03\/6384584900551839601646466.png\" alt=\"\" width=\"575\" height=\"431\" \/><\/p>\n<p>\u653b\u51fb\u7684\u6838\u5fc3\u76ee\u6807\u662f\u6a21\u578b\u7684\u5d4c\u5165\u6295\u5f71\u5c42\uff0c\u5373\u6a21\u578b\u7684\u6700\u540e\u4e00\u5c42\uff0c\u8d1f\u8d23\u5c06\u9690\u85cf\u7ef4\u5ea6\u6620\u5c04\u5230logits\u5411\u91cf\u3002\u901a\u8fc7\u5411\u6a21\u578b\u7684API\u53d1\u51fa\u9488\u5bf9\u6027\u67e5\u8be2\uff0c\u53ef\u4ee5\u63d0\u53d6\u51fa\u6a21\u578b\u7684\u5d4c\u5165\u7ef4\u5ea6\u6216\u8005\u6700\u7ec8\u6743\u91cd\u77e9\u9635\u3002\u8c37\u6b4c\u901a\u8fc7\u5927\u91cf\u67e5\u8be2\u548c\u5947\u5f02\u503c\u6392\u5e8f\u6210\u529f\u8bc6\u522b\u51fa\u6a21\u578b\u7684\u9690\u85cf\u7ef4\u5ea6\u3002<\/p>\n<p>\u8be5\u653b\u51fb\u65b9\u6cd5\u4e0d\u4ec5\u53ef\u4ee5\u63ed\u793a\u6a21\u578b\u7684\u9690\u85cf\u7ef4\u5ea6\uff0c\u8fd8\u80fd\u83b7\u53d6\u6a21\u578b\u7684\u201c\u5bbd\u5ea6\u201d\uff08\u603b\u4f53\u53c2\u6570\u91cf\uff09\u7b49\u5168\u5c40\u6027\u4fe1\u606f\uff0c\u964d\u4f4e\u6a21\u578b\u7684\u201c\u9ed1\u76d2\u7a0b\u5ea6\u201d\uff0c\u4e3a\u540e\u7eed\u653b\u51fb\u201c\u94fa\u8def\u201d\u3002\u7814\u7a76\u56e2\u961f\u8868\u793a\uff0c\u8fd9\u79cd\u653b\u51fb\u975e\u5e38\u9ad8\u6548\uff0c\u653b\u51fbOpenAI\u7684Ada\u548cBabbage\u6a21\u578b\u4ee5\u53caGPT-3.5\u5206\u522b\u53ea\u9700\u4e0d\u523020\u7f8e\u5143\u548c\u5927\u7ea6200\u7f8e\u5143\u3002<\/p>\n<p>OpenAI\u5df2\u7ecf\u5f97\u77e5\u8fd9\u4e00\u60c5\u51b5\uff0c\u5e76\u5728\u7814\u7a76\u56e2\u961f\u5f81\u5f97\u540c\u610f\u540e\u786e\u8ba4\u4e86\u653b\u51fb\u7684\u6709\u6548\u6027\uff0c\u6700\u7ec8\u5220\u9664\u4e86\u6240\u6709\u4e0e\u653b\u51fb\u76f8\u5173\u7684\u6570\u636e\u3002\u867d\u7136\u8fd9\u79cd\u653b\u51fb\u65b9\u5f0f\u83b7\u53d6\u7684\u4fe1\u606f\u5e76\u4e0d\u591a\uff0c\u4f46\u5176\u4f4e\u6210\u672c\u548c\u9ad8\u6548\u6027\u4ee4\u4eba\u9707\u60ca\u3002<\/p>\n<p>\u8bba\u6587\u4e2d\u63d0\u5230\u7684\u9632\u5fa1\u63aa\u65bd\u5305\u62ec\u4eceAPI\u4e0b\u624b\uff0c\u5f7b\u5e95\u5220\u9664logit bias\u53c2\u6570\uff0c\u6216\u8005\u76f4\u63a5\u4ece\u6a21\u578b\u67b6\u6784\u4e0b\u624b\uff0c\u5728\u8bad\u7ec3\u5b8c\u6210\u540e\u4fee\u6539\u6700\u540e\u4e00\u5c42\u7684\u9690\u85cf\u7ef4\u5ea6\u7b49\u3002\u5728\u6b64\u4e8b\u4ef6\u66dd\u5149\u540e\uff0cOpenAI\u5df2\u7ecf\u91c7\u53d6\u4e86\u4fee\u6539\u6a21\u578bAPI\u7684\u63aa\u65bd\uff0c\u9632\u6b62\u7c7b\u4f3c\u653b\u51fb\u518d\u6b21\u53d1\u751f\u3002<\/p>\n<p>\u8fd9\u9879\u7814\u7a76\u63ed\u793a\u4e86\u5373\u4f7f\u662f\u5927\u578b\u8bed\u8a00\u6a21\u578b\u4e5f\u53ef\u80fd\u9762\u4e34\u5b89\u5168\u5a01\u80c1\uff0c\u5373\u4fbfOpenAI\u5df2\u7ecf\u91c7\u53d6\u4e86\u4e00\u5b9a\u7684\u9632\u5fa1\u63aa\u65bd\u3002\u8fd9\u4e00\u4e8b\u4ef6\u63d0\u9192\u4e86\u4eba\u4eec\uff0c\u4fdd\u969c\u6a21\u578b\u7684\u5b89\u5168\u6027\u4ecd\u7136\u662f\u4e00\u4e2a\u590d\u6742\u800c\u91cd\u8981\u7684\u95ee\u9898\u3002<\/p>\n<p>\u8bba\u6587\u94fe\u63a5:https:\/\/arxiv.org\/abs\/2403.06634<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The latest Google study revealed a method of attacking large language models, successfully stealing key information from OpenAI GPT-3.5-turbo models. According to Google ' s statement, not only did they restore the entire projection matrix of the large OpenAI model, but they also acquired the exact size of the hidden dimension, all at less than 2,000 ingenious API queries at a cost of up to $150. The core target of the attack is the embedded projection layer of the model, the last layer of the model, which is responsible for mapping hidden dimensions to the logits vector. By sending a targeted query to the API of the model, you can extract the embedded dimensions of the model or the final weight matrix. Google has been successful in identifying the hidden dimensions of the model through a large number of queries and odd-value sequencing. The method of attack not only reveals the hidden nature of the model<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[1033,371,281],"collection":[],"class_list":["post-5412","post","type-post","status-publish","format-standard","hentry","category-news","tag-api","tag-371","tag-281"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/5412","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=5412"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/5412\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=5412"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=5412"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=5412"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=5412"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}