{"id":12140,"date":"2024-06-04T09:31:59","date_gmt":"2024-06-04T01:31:59","guid":{"rendered":"https:\/\/www.1ai.net\/?p=12140"},"modified":"2024-06-04T09:31:59","modified_gmt":"2024-06-04T01:31:59","slug":"%e5%85%a8%e7%90%83%e9%a6%96%e5%88%9b%e5%8d%95%e5%8f%b0-rtx-4090-%e6%9c%8d%e5%8a%a1%e5%99%a8%e6%8e%a8%e7%90%86%ef%bc%8c%e6%98%86%e4%bb%91%e4%b8%87%e7%bb%b4%e5%bc%80%e6%ba%90-2","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/12140.html","title":{"rendered":""World's First" Single RTX 4090 Server Inference, Kunlun Wanwei Open Source 200 Billion Sparse Large Model Tiangong MoE"},"content":{"rendered":"

\u6606\u4ed1\u4e07\u7ef4<\/a>\u4eca\u65e5\u5ba3\u5e03\u5f00\u6e90<\/a> 2 \u5343\u4ebf\u7a00\u758f\u5927\u6a21\u578b<\/a> Skywork-MoE\uff0c\u57fa\u4e8e\u4e4b\u524d\u6606\u4ed1\u4e07\u7ef4\u5f00\u6e90\u7684 Skywork-13B \u6a21\u578b\u4e2d\u95f4 checkpoint \u6269\u5c55\u800c\u6765\uff0c\u53f7\u79f0\u662f\u9996\u4e2a\u5b8c\u6574\u5c06 MoE Upcycling \u6280\u672f\u5e94\u7528\u5e76\u843d\u5730\u7684\u5f00\u6e90\u5343\u4ebf MoE \u5927\u6a21\u578b\uff0c\u4e5f\u662f\u9996\u4e2a\u652f\u6301\u7528\u5355\u53f0 RTX 4090 \u670d\u52a1\u5668\uff088 \u5f20 RTX 4090 \u663e\u5361\uff09\u63a8\u7406\u7684\u5f00\u6e90\u5343\u4ebf MoE \u5927\u6a21\u578b\u3002<\/p>\n

\u636e\u4ecb\u7ecd\uff0c\u672c\u6b21\u5f00\u6e90\u7684 Skywork-MoE \u6a21\u578b\u96b6\u5c5e\u4e8e\u5929\u5de5 3.0 \u7684\u7814\u53d1\u6a21\u578b\u7cfb\u5217\uff0c\u662f\u5176\u4e2d\u7684\u4e2d\u6863\u5927\u5c0f\u6a21\u578b\uff08Skywork-MoE-Medium\uff09\uff0c\u6a21\u578b\u7684\u603b\u53c2\u6570\u91cf\u4e3a 146B\uff0c\u6fc0\u6d3b\u53c2\u6570\u91cf 22B\uff0c\u5171\u6709 16 \u4e2a Expert\uff0c\u6bcf\u4e2a Expert \u5927\u5c0f\u4e3a 13B\uff0c\u6bcf\u6b21\u6fc0\u6d3b\u5176\u4e2d\u7684 2 \u4e2a Expert\u3002<\/p>\n

\u5929\u5de5 3.0 \u8fd8\u8bad\u7ec3\u4e86 75B \uff08Skywork-MoE-Small\uff09 \u548c 400B \uff08Skywork-MoE-Large\uff09\u4e24\u6863 MoE \u6a21\u578b\uff0c\u5e76\u4e0d\u5728\u6b64\u6b21\u5f00\u6e90\u4e4b\u5217\u3002<\/p>\n

\u6839\u636e\u5b98\u65b9\u6d4b\u8bd5\uff0c\u5728\u76f8\u540c\u7684\u6fc0\u6d3b\u53c2\u6570\u91cf 20B\uff08\u63a8\u7406\u8ba1\u7b97\u91cf\uff09\u4e0b\uff0cSkywork-MoE \u80fd\u529b\u63a5\u8fd1 70B \u7684 Dense \u6a21\u578b\uff0c\u4f7f\u5f97\u6a21\u578b\u7684\u63a8\u7406\u6210\u672c\u6709\u8fd1 3 \u500d\u7684\u4e0b\u964d\u3002\u540c\u65f6 Skywork-MoE \u7684\u603b\u53c2\u6570\u5927\u5c0f\u6bd4 DeepSeekV2 \u7684\u603b\u53c2\u6570\u5927\u5c0f\u8981\u5c0f 1\/3\uff0c\u7528\u66f4\u5c0f\u7684\u53c2\u6570\u89c4\u6a21\u505a\u5230\u4e86\u76f8\u8fd1\u7684\u80fd\u529b\u3002<\/p>\n

\"d7abed8c-9c9c-4f93-9d25-9d67b94e0d7a\"<\/p>\n

Skywork-MoE \u7684\u6a21\u578b\u6743\u91cd\u3001\u6280\u672f\u62a5\u544a\u5b8c\u5168\u5f00\u6e90\uff0c\u514d\u8d39\u5546\u7528\uff0c\u65e0\u9700\u7533\u8bf7\uff0c\u9644\u94fe\u63a5\u5982\u4e0b\uff1a<\/p>\n

\u6a21\u578b\u6743\u91cd\u4e0b\u8f7d\uff1a<\/p>\n

https:\/\/huggingface.co\/Skywork\/Skywork-MoE-base<\/p>\n

https:\/\/huggingface.co\/Skywork\/Skywork-MoE-Base-FP8<\/p>\n

\u6a21\u578b\u5f00\u6e90\u4ed3\u5e93\uff1ahttps:\/\/github.com\/SkyworkAI\/Skywork-MoE<\/p>\n

\u6a21\u578b\u6280\u672f\u62a5\u544a\uff1ahttps:\/\/github.com\/SkyworkAI\/Skywork-MoE\/blob\/main\/skywork-moe-tech-report.pdf<\/p>\n

\u6a21\u578b\u63a8\u7406\u4ee3\u7801\uff1a\uff08\u652f\u6301 8 x 4090 \u670d\u52a1\u5668\u4e0a 8 bit \u91cf\u5316\u52a0\u8f7d\u63a8\u7406\uff09 https:\/\/github.com\/SkyworkAI\/vllm<\/p>\n","protected":false},"excerpt":{"rendered":"

Kunlun World Wide today announced the open source 200 billion sparse model Skywork-MoE, based on the previous Kunlun World Wide's open source Skywork-13B model middle checkpoint extension, said to be the first complete MoE Upcycling technology application and landing of the open source 100 billion MoE model, but also the first to support the use of a single RTX 4090 server (8 RTX 4090 graphics cards) reasoning. It is also the first open source MoE model that supports reasoning with a single RTX 4090 server (8 RTX 4090 graphics cards). According to the introduction, the open source Skywork-MoE model belongs to the R&D model series of Skywork 3.0, which is a medium-sized model (Skywork-MoE-Medium), with the total number of parameters of the model as follows<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[216,219,1050],"collection":[],"class_list":["post-12140","post","type-post","status-publish","format-standard","hentry","category-news","tag-216","tag-219","tag-1050"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/12140","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=12140"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/12140\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=12140"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=12140"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=12140"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=12140"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}