{"id":7179,"date":"2024-04-04T09:38:16","date_gmt":"2024-04-04T01:38:16","guid":{"rendered":"https:\/\/www.1ai.net\/?p=7179"},"modified":"2024-04-04T09:38:16","modified_gmt":"2024-04-04T01:38:16","slug":"%e5%85%83%e8%b1%a1%e5%8f%91%e5%b8%83-xverse-moe-a4-2b-%e5%a4%a7%e6%a8%a1%e5%9e%8b-%e5%8f%af%e5%85%8d%e8%b4%b9%e5%95%86%e7%94%a8","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/7179.html","title":{"rendered":"Yuanxiang releases XVERSE-MoE-A4.2B large model for free commercial use"},"content":{"rendered":"<p><a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%85%83%e8%b1%a1\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u5143\u8c61]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u5143\u8c61<\/a>\u53d1\u5e03\u4e86\u00a0XVERSE-MoE-A4.2B\u00a0<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%a4%a7%e6%a8%a1%e5%9e%8b\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u5927\u6a21\u578b]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u5927\u6a21\u578b<\/a>\uff0c\u91c7\u7528\u6df7\u5408\u4e13\u5bb6\u6a21\u578b\u67b6\u6784\uff0c\u6fc0\u6d3b\u53c2\u6570\u4e3a4.2B\uff0c\u6548\u679c\u5ab2\u7f8e13B \u6a21\u578b\u3002\u8be5\u6a21\u578b\u5168<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%bc%80%e6%ba%90\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u5f00\u6e90]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u5f00\u6e90<\/a>\uff0c<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e5%85%8d%e8%b4%b9%e5%95%86%e7%94%a8\" title=\"\u3010\u67e5\u770b\u542b\u6709[\u514d\u8d39\u5546\u7528]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">\u514d\u8d39\u5546\u7528<\/a>\uff0c\u53ef\u7528\u4e8e\u6d77\u91cf\u4e2d\u5c0f\u4f01\u4e1a\u3001\u7814\u7a76\u8005\u548c\u5f00\u53d1\u8005\uff0c\u63a8\u52a8\u4f4e\u6210\u672c\u90e8\u7f72\u3002<\/p>\n<p>\u8be5\u6a21\u578b\u5177\u6709<span class=\"spamTxt\">\u6781\u81f4<\/span>\u538b\u7f29\u548c\u8d85\u51e1\u6027\u80fd\u4e24\u5927\u4f18\u52bf\uff0c\u91c7\u7528\u7a00\u758f\u6fc0\u6d3b\u6280\u672f\uff0c\u6548\u679c\u8d85\u8d8a\u591a\u4e2a\u4e1a\u754c\u9876\u6d41\u6a21\u578b\uff0c\u5e76\u63a5\u8fd1\u8d85\u5927\u6a21\u578b\u3002\u5143\u8c61 MoE \u6280\u672f\u81ea\u7814\u521b\u65b0\uff0c\u7814\u53d1\u9ad8\u6548\u878d\u5408\u7b97\u5b50\u3001\u7ec6\u7c92\u5ea6\u4e13\u5bb6\u8bbe\u8ba1\u3001\u8d1f\u8f7d\u5747\u8861\u635f\u5931\u9879\u7b49\uff0c\u6700\u7ec8\u91c7\u7528\u5b9e\u9a8c4\u5bf9\u5e94\u7684\u67b6\u6784\u8bbe\u7f6e\u3002<\/p>\n<p class=\"article-content__img\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-7180\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/04\/6384775113342083014263156.jpg\" alt=\"\" width=\"691\" height=\"515\" \/><\/p>\n<p>\u5728\u5546\u4e1a\u5e94\u7528\u4e0a\uff0c\u5143\u8c61\u5927\u6a21\u578b\u5df2\u4e0e\u591a\u4e2a\u817e\u8baf\u4ea7\u54c1\u8fdb\u884c\u6df1\u5ea6\u5408\u4f5c\uff0c\u4e3a\u6587\u5316\u3001\u5a31\u4e50\u3001\u65c5\u6e38\u3001\u91d1\u878d\u9886\u57df\u63d0\u4f9b\u521b\u65b0\u7528\u6237\u4f53\u9a8c\u3002<\/p>\n<ul>\n<li>Hugging Face:https:\/\/huggingface.co\/xverse\/XVERSE-MoE-A4.2B<\/li>\n<li>ModelScope\u9b54\u642d:https:\/\/modelscope.cn\/models\/xverse\/XVERSE-MoE-A4.2B<\/li>\n<li>Github:https:\/\/github.com\/xverse-ai\/XVERSE-MoE-A4.2B<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Yuanxiang has released the XVERSE-MoE-A4.2B large model, which adopts a hybrid expert model architecture with 4.2B activation parameters, comparable to a 13B model. The model is fully open source, free for commercial use, and can be used by a large number of SMEs, researchers and developers to promote low-cost deployment. The model has two major advantages: extreme compression and extraordinary performance. Using sparse activation technology, the model surpasses many top stream models in the industry and is close to mega models. Meta-Elephant MoE technology is self-researching and innovative, developing efficient fusion operators, fine-grained expert design, load-balancing loss terms, etc., and finally adopting the architecture setup corresponding to Experiment 4. In terms of commercial applications, Yuanxiang MoE has been deeply cooperating with several Tencent products, providing innovative user experiences in the fields of culture, entertainment, tourism, and finance. Huggin<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[1936,2074,216,219],"collection":[],"class_list":["post-7179","post","type-post","status-publish","format-standard","hentry","category-news","tag-1936","tag-2074","tag-216","tag-219"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/7179","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=7179"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/7179\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=7179"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=7179"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=7179"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=7179"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}