{"id":1794,"date":"2023-12-08T11:29:31","date_gmt":"2023-12-08T03:29:31","guid":{"rendered":"https:\/\/www.1ai.net\/?p=1794"},"modified":"2023-12-08T11:29:31","modified_gmt":"2023-12-08T03:29:31","slug":"stability-ai%e5%8f%91%e5%b8%8330%e4%ba%bf%e5%8f%82%e6%95%b0%e8%af%ad%e8%a8%80%e6%a8%a1%e5%9e%8bstablelm-zephyr-3b-%e6%9b%b4%e5%b0%8f%e6%9b%b4%e5%bf%ab%e6%9b%b4%e8%8a%82%e7%9c%81%e8%b5%84%e6%ba%90","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/1794.html","title":{"rendered":"Stability AI releases 3 billion parameter language model StableLM Zephyr 3B, which is smaller, faster and more resource-efficient"},"content":{"rendered":"<p><a href=\"https:\/\/www.1ai.net\/en\/tag\/stability\" title=\"\u3010\u67e5\u770b\u542b\u6709[Stability]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">Stability<\/a> AI\u4ee5\u5176stable diffusion\u6587\u672c\u5230\u56fe\u50cf\u7684\u751f\u6210<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e4%ba%ba%e5%b7%a5%e6%99%ba%e8%83%bd%e6%a8%a1%e5%9e%8b\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u4eba\u5de5\u667a\u80fd\u6a21\u578b]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u4eba\u5de5\u667a\u80fd\u6a21\u578b<\/a>\u800c\u95fb\u540d\uff0c\u4f46\u8fd9\u5df2\u4e0d\u518d\u662f\u8be5\u516c\u53f8\u7684\u5168\u90e8\u4e1a\u52a1\u3002<\/p>\n<p><span class=\"spamTxt\">\u6700\u65b0<\/span>\u53d1\u5e03\u7684StableLM Zephyr3B\u662f\u4e00\u6b3e30\u4ebf\u53c2\u6570\u7684\u5927\u8bed\u8a00\u6a21\u578b\uff0c\u4e13\u4e3a\u804a\u5929\u5e94\u7528\u573a\u666f\u8fdb\u884c\u4e86\u4f18\u5316\uff0c\u5305\u62ec\u6587\u672c\u751f\u6210\u3001\u6458\u8981\u548c\u5185\u5bb9\u4e2a\u6027\u5316\u3002\u8fd9\u6b3e\u65b0\u6a21\u578b\u662fStability AI\u65e9\u5728\u4eca\u5e74\u56db\u6708<span class=\"spamTxt\">\u9996\u6b21<\/span>\u63d0\u53ca\u7684StableLM\u6587\u672c\u751f\u6210\u6a21\u578b\u7684\u8f83\u5c0f\u3001\u4f18\u5316\u7248\u672c\u3002<\/p>\n<p>StableLM Zephyr3B\u7684\u627f\u8bfa\u5728\u4e8e\uff0c\u5b83\u6bd47B\u7684StableLM\u6a21\u578b\u66f4\u5c0f\uff0c\u5e26\u6765\u4e86\u4e00\u7cfb\u5217\u597d\u5904\u3002\u7531\u4e8e\u4f53\u79ef\u66f4\u5c0f\uff0c\u5b83\u53ef\u4ee5\u5728\u66f4\u5e7f\u6cdb\u7684\u786c\u4ef6\u4e0a\u90e8\u7f72\uff0c\u5360\u7528\u66f4\u4f4e\u7684\u8d44\u6e90\uff0c\u540c\u65f6\u4ecd\u7136\u63d0\u4f9b\u5feb\u901f\u54cd\u5e94\u3002\u8be5\u6a21\u578b\u7ecf\u8fc7\u4f18\u5316\uff0c\u7279\u522b\u9002\u7528\u4e8e\u95ee\u7b54\u548c\u6307\u4ee4\u8ddf\u968f\u7c7b\u578b\u7684\u4efb\u52a1\u3002<\/p>\n<p class=\"article-content__img\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1795\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2023\/12\/6383762748295156092412489.png\" alt=\"\" width=\"552\" height=\"457\" \/><\/p>\n<p>Stability AI\u9996\u5e2d\u6267\u884c\u5b98Emad Mostaque\u8868\u793a:\u201c\u76f8\u5bf9\u4e8e\u4ee5\u524d\u7684\u6a21\u578b\uff0cStableLM\u7ecf\u8fc7\u66f4\u957f\u65f6\u95f4\u3001\u66f4\u9ad8\u8d28\u91cf\u6570\u636e\u7684\u8bad\u7ec3\uff0c\u4f8b\u5982\u4e0eLLaMA v27b\u76f8\u6bd4\uff0c\u5c3d\u7ba1\u4f53\u79ef\u53ea\u6709\u517640%\uff0c\u4f46\u5728\u57fa\u7840\u6027\u80fd\u4e0a\u5374\u80fd\u591f\u5339\u914d\u3002\u201d<\/p>\n<p>StableLM Zephyr3B\u5e76\u975e\u5168\u65b0\u6a21\u578b\uff0c\u800c\u662fStability AI\u5b9a\u4e49\u7684\u73b0\u6709StableLM3B-4e1t\u6a21\u578b\u7684\u6269\u5c55\u3002Zephyr\u7684\u8bbe\u8ba1\u65b9\u6cd5\u53d7\u5230HuggingFace\u7684Zephyr7B\u6a21\u578b\u7684\u542f\u53d1\u3002HuggingFace\u7684Zephyr\u6a21\u578b\u662f\u5728\u5f00\u6e90MIT\u8bb8\u53ef\u4e0b\u5f00\u53d1\u7684\uff0c\u65e8\u5728\u5145\u5f53\u52a9\u624b\u3002Zephyr\u91c7\u7528\u4e00\u79cd\u79f0\u4e3aDirect Preference Optimization\uff08DPO\uff09\u7684\u8bad\u7ec3\u65b9\u6cd5\uff0cStableLM\u73b0\u5728\u4e5f\u53d7\u76ca\u4e8e\u8fd9\u4e00\u65b9\u6cd5\u3002<\/p>\n<p>Mostaque\u89e3\u91ca\u8bf4\uff0cDirect Preference Optimization\uff08DPO\uff09\u662f\u4e00\u79cd\u66ff\u4ee3\u4ee5\u524d\u6a21\u578b\u4e2d\u4f7f\u7528\u7684\u5f3a\u5316\u5b66\u4e60\u7684\u65b9\u6cd5\uff0c\u7528\u4e8e\u8c03\u6574\u6a21\u578b\u4ee5\u7b26\u5408\u4eba\u7c7b\u504f\u597d\u3002DPO\u901a\u5e38\u7528\u4e8e\u66f4\u5927\u768470\u4ebf\u53c2\u6570\u6a21\u578b\uff0c\u800cStableLM Zephyr\u662f\u9996\u6279\u5728\u66f4\u5c0f\u768430\u4ebf\u53c2\u6570\u5927\u5c0f\u4e2d\u4f7f\u7528\u8be5\u6280\u672f\u7684\u6a21\u578b\u4e4b\u4e00\u3002<\/p>\n<p>Stability AI\u4f7f\u7528\u4e86\u6765\u81eaOpenBMB\u7814\u7a76\u7ec4\u7684UltraFeedback\u6570\u636e\u96c6\u8fdb\u884cDPO\u3002UltraFeedback\u6570\u636e\u96c6\u5305\u542b\u8d85\u8fc764\uff0c000\u4e2a\u63d0\u793a\u548c256\uff0c000\u4e2a\u54cd\u5e94\u3002DPO\u3001\u8f83\u5c0f\u7684\u4f53\u79ef\u548c\u4f18\u5316\u7684\u6570\u636e\u8bad\u7ec3\u96c6\u7684\u7ec4\u5408\u4e3aStableLM\u63d0\u4f9b\u4e86\u5728Stability AI\u63d0\u4f9b\u7684\u6307\u6807\u4e2d\u8868\u73b0\u51fa\u8272\u3002\u4f8b\u5982\uff0c\u5728MT Bench\u8bc4\u4f30\u4e2d\uff0cStableLM Zephyr3B\u80fd\u591f\u80dc\u8fc7\u5305\u62ecMeta\u7684Llama-2-70b-chat\u548cAnthropric\u7684Claude-V1\u5728\u5185\u7684\u66f4\u5927\u6a21\u578b\u3002<\/p>\n<p>StableLM Zephyr3B\u662fStability AI\u8fd1\u51e0\u4e2a\u6708\u63a8\u51fa\u7684\u4e00\u7cfb\u5217\u65b0\u6a21\u578b\u4e4b\u4e00\uff0c\u8be5\u521d\u521b\u516c\u53f8\u7ee7\u7eed\u63a8\u52a8\u5176\u80fd\u529b\u548c\u5de5\u5177\u7684\u53d1\u5c55\u3002\u867d\u7136\u516c\u53f8\u5fd9\u4e8e\u8fdb\u5165\u4e0d\u540c\u9886\u57df\uff0c\u4f46\u65b0\u6a21\u578b\u5e76\u6ca1\u6709\u8ba9Stability AI\u5fd8\u8bb0\u6587\u672c\u5230\u56fe\u50cf\u751f\u6210\u7684\u57fa\u7840\u3002\u4e0a\u5468\uff0cStability AI\u53d1\u5e03\u4e86SDXL Turbo\uff0c\u4f5c\u4e3a\u5176\u65d7\u8230SDXL\u6587\u672c\u5230\u56fe\u50cfstable diffusion\u6a21\u578b\u7684\u66f4\u5feb\u7248\u672c\u3002<\/p>\n<p>Mostaque\u8fd8\u660e\u786e\u8868\u793a\uff0cStability AI\u8fd8\u5c06\u63a8\u51fa\u66f4\u591a\u521b\u65b0\u3002\u4ed6\u8868\u793a:\u201c\u6211\u4eec\u76f8\u4fe1\uff0c\u9488\u5bf9\u7528\u6237\u81ea\u5df1\u7684\u6570\u636e\u8fdb\u884c\u8c03\u6574\u7684\u5c0f\u578b\u3001\u5f00\u653e\u3001\u6027\u80fd\u826f\u597d\u7684\u6a21\u578b\u5c06\u80dc\u8fc7\u66f4\u5927\u7684\u901a\u7528\u6a21\u578b\u3002\u968f\u7740\u6211\u4eec\u65b0\u7684StableLM\u6a21\u578b\u7684\u672a\u6765\u5168\u9762\u53d1\u5e03\uff0c\u6211\u4eec\u671f\u5f85\u8fdb\u4e00\u6b65\u5b9e\u73b0\u751f\u6210\u8bed\u8a00\u6a21\u578b\u7684\u6c11\u4e3b\u5316\u3002\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Stability AI is well known for the artificial intelligence model of the generation of its stable Diffusion text to images, but it is no longer the company ' s entire business. The recently released StableLM Zephyr3B is a large-language model of 3 billion parameters that optimizes chat applications, including text generation, summary and content personalization. This new model is a relatively small and optimized version of the StableLM Text Generation Model, which was first mentioned by Stability AI in April this year. The commitment of StableLM Zephyr3B is that it is smaller than the 7B StableLM model, with a range of benefits. Because of its smaller size, it can be deployed on a wider hardware scale, with lower occupancy<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[388,599],"collection":[],"class_list":["post-1794","post","type-post","status-publish","format-standard","hentry","category-news","tag-stability","tag-599"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/1794","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=1794"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/1794\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=1794"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=1794"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=1794"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=1794"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}