{"id":29002,"date":"2025-02-18T19:56:52","date_gmt":"2025-02-18T11:56:52","guid":{"rendered":"https:\/\/www.1ai.net\/?p=29002"},"modified":"2025-02-18T19:56:52","modified_gmt":"2025-02-18T11:56:52","slug":"deepseek-%e5%86%8d%e6%94%be%e9%99%8d%e6%9c%ac%e5%a4%a7%e6%8b%9b%ef%bc%9ansa-%e5%ae%98%e5%ae%a3%e5%8f%91%e5%b8%83%ef%bc%8c%e5%8a%a0%e9%80%9f%e6%8e%a8%e7%90%86%e9%99%8d%e4%bd%8e%e6%88%90%e6%9c%ac","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/29002.html","title":{"rendered":"DeepSeek Releases Another Cost-Reducing Move: NSA Announces Release, Accelerates Inference to Reduce Costs and Doesn't Sacrifice Performance"},"content":{"rendered":"<p>2 \u6708 18 \u65e5\u6d88\u606f\uff0c<a href=\"https:\/\/www.1ai.net\/en\/tag\/deepseek\" title=\"\u3010\u67e5\u770b\u542b\u6709[DeepSeek]\u6807\u7b7e\u7684\u6587\u7ae0\u3011\" target=\"_blank\" rel=\"noopener\">DeepSeek<\/a> \u4eca\u65e5\u5b98\u5ba3\u63a8\u51fa\u00a0<strong>NSA\uff08Native Sparse Attention\uff09<\/strong>\uff0c\u8fd9\u662f\u4e00\u79cd\u786c\u4ef6\u5bf9\u9f50\u4e14\u539f\u751f\u53ef\u8bad\u7ec3\u7684\u7a00\u758f\u6ce8\u610f\u529b\u673a\u5236\uff0c\u7528\u4e8e\u8d85\u5feb\u901f\u957f\u4e0a\u4e0b\u6587\u8bad\u7ec3\u4e0e\u63a8\u7406\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-29003\" title=\"34c13fd5j00srvnu40052d000v900ggp\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2025\/02\/34c13fd5j00srvnu40052d000v900ggp.jpg\" alt=\"34c13fd5j00srvnu40052d000v900ggp\" width=\"1125\" height=\"592\" \/><\/p>\n<p>NSA \u7684\u6838\u5fc3\u7ec4\u4ef6\u5305\u62ec\uff1a<\/p>\n<ul>\n<li>\u52a8\u6001\u5206\u5c42\u7a00\u758f\u7b56\u7565<\/li>\n<li>\u7c97\u7c92\u5ea6 token \u538b\u7f29<\/li>\n<li>\u7ec6\u7c92\u5ea6 token \u9009\u62e9<\/li>\n<\/ul>\n<p>DeepSeek \u5b98\u65b9\u8868\u793a\uff0c\u8be5\u673a\u5236\u53ef\u4f18\u5316\u73b0\u4ee3\u786c\u4ef6\u8bbe\u8ba1\uff0c<strong>\u52a0\u901f\u63a8\u7406\u540c\u65f6\u964d\u4f4e\u9884\u8bad\u7ec3\u6210\u672c\uff0c\u5e76\u4e14\u4e0d\u727a\u7272\u6027\u80fd<\/strong>\u3002\u5728\u901a\u7528\u57fa\u51c6\u3001\u957f\u4e0a\u4e0b\u6587\u4efb\u52a1\u548c\u57fa\u4e8e\u6307\u4ee4\u7684\u63a8\u7406\u4e0a\uff0c\u5176\u8868\u73b0\u4e0e\u5168\u6ce8\u610f\u529b\u6a21\u578b\u76f8\u5f53\u6216\u66f4\u52a0\u4f18\u79c0\u3002<\/p>\n<p>\u9644\u8bba\u6587\u94fe\u63a5\uff1a<\/p>\n<p>https:\/\/arxiv.org\/abs\/2502.11089<\/p>\n","protected":false},"excerpt":{"rendered":"<p>February 18, 2012 - DeepSeek today announced the launch of NSA (Native Sparse Attention), a hardware-aligned and natively trainable sparse attention mechanism for ultra-fast long context training and inference. The core components of NSA include: Dynamic Hierarchical Sparse Policies Coarse-Grained Token Compression Fine-Grained Token Selection DeepSeek says the mechanism is optimized for modern hardware designs, accelerating inference while reducing pre-training costs, without sacrificing performance. It performs as well as or better than full-attention models on generalized benchmarks, long context tasks, and instruction-based reasoning. With link to the paper: https:\/\/arxiv.org\/ab<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[146],"tags":[3606],"collection":[],"class_list":["post-29002","post","type-post","status-publish","format-standard","hentry","category-news","tag-deepseek"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/29002","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=29002"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/29002\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=29002"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=29002"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=29002"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=29002"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}