{"id":5760,"date":"2024-03-19T09:33:47","date_gmt":"2024-03-19T01:33:47","guid":{"rendered":"https:\/\/www.1ai.net\/?p=5760"},"modified":"2024-03-19T09:33:47","modified_gmt":"2024-03-19T01:33:47","slug":"%e8%8b%b1%e4%bc%9f%e8%be%be%e5%8f%91%e5%b8%83%e6%9c%80%e5%bc%baai%e5%8a%a0%e9%80%9f%e5%8d%a1-%e5%a4%a7%e8%af%ad%e8%a8%80%e6%a8%a1%e5%9e%8b%e6%80%a7%e8%83%bd%e6%af%94h100%e6%8f%90%e5%8d%8730%e5%80%8d","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/5760.html","title":{"rendered":"NVIDIA releases the most powerful AI accelerator card, with large language model performance 30 times higher than H100"},"content":{"rendered":"<p><a href=\"https:\/\/www.1ai.net\/en\/tag\/%e8%8b%b1%e4%bc%9f%e8%be%be\" title=\"Look at the article with the label\" target=\"_blank\" >Nvidia<\/a>Released at the GTC Developer Conference<span class=\"spamTxt\">Strongest<\/span>\u00a0AI Accelerator Card Blackwell\u00a0<a href=\"https:\/\/www.1ai.net\/en\/tag\/gb200\" title=\"[SEE ARTICLES WITH [GB200] LABELS]\" target=\"_blank\" >GB200<\/a>, which is scheduled to ship later this year.<\/p>\n<p>The GB200 utilizes Blackwell, the next-generation AI graphics processor architecture, which delivers up to 20 petaflops of AI performance, a 5x improvement over the previous H100. Each Blackwell Die has 251 TP3T more floating point capacity than the Hopper Die, and with two Blackwell chips in each package, total performance is increased by 2.5x.<\/p>\n<p>The GB200 includes two B200Blackwell GPUs and an Arm-based Grace CPU, delivering up to 30x performance improvement over the H100 for inference of large language models, and reducing cost and power consumption to a quarter.<\/p>\n<p class=\"article-content__img\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-5761\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/03\/6384643304103230671366576.jpg\" alt=\"\" width=\"567\" height=\"408\" \/><\/p>\n<p>NVIDIA says that 2,000 Blackwell GPUs can accomplish training tasks that previously required 8,000 Hopper GPUs and 15 megawatts of power. NVIDIA also provided the GB200NVL72 server, which provides 36 CPUs and 72 Blackwell GPUs and achieves 720 petaflops of AI training performance or 1.4 exaflops of inference performance.<\/p>\n<p>NVIDIA's systems are also scalable to tens of thousands of GB200<span class=\"spamTxt\">super<\/span>chip with 11.5 exaflops of FP4 computing power.<\/p>","protected":false},"excerpt":{"rendered":"<p>NVIDIA unveiled its most powerful AI acceleration card, the Blackwell GB200, at the GTC developer conference, with plans to ship later this year. The GB200 utilizes Blackwell, a next-generation AI graphics processor architecture that delivers up to 20 petaflops of AI performance, a 5x improvement over the previous H100. Each Blackwell Die has 25% more floating-point capacity than the Hopper Die, and there are two Blackwell chips in each package for a 2.5x increase in total performance. The GB200 includes two B200Blackwell GPUs and an Arm-based Grace CPU, reasoning about large language model performance<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[1744,239],"collection":[],"class_list":["post-5760","post","type-post","status-publish","format-standard","hentry","category-news","tag-gb200","tag-239"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/5760","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=5760"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/5760\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=5760"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=5760"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=5760"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=5760"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}