{"id":24886,"date":"2024-12-11T09:40:32","date_gmt":"2024-12-11T01:40:32","guid":{"rendered":"https:\/\/www.1ai.net\/?p=24886"},"modified":"2024-12-11T09:40:32","modified_gmt":"2024-12-11T01:40:32","slug":"ibm-%e5%85%a8%e6%96%b0%e5%85%89%e5%ad%a6%e6%8a%80%e6%9c%af%e5%8f%af%e7%bc%a9%e7%9f%ad-gpu-%e9%97%b2%e7%bd%ae%e6%97%b6%e9%97%b4%ef%bc%8c%e5%a4%a7%e5%b9%85%e5%8a%a0%e5%bf%ab-ai%e6%a8%a1%e5%9e%8b","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/24886.html","title":{"rendered":"IBM's New Optical Technology Reduces GPU Idle Time, Dramatically Speeds AI Model Training"},"content":{"rendered":"<p>December 11th.<a href=\"https:\/\/www.1ai.net\/en\/tag\/ibm\" title=\"_OTHER ORGANISER\" target=\"_blank\" >IBM<\/a> announced the development of a new optical technology that can train AI models at the speed of light while saving significant energy. By applying this breakthrough to data centers, the company says that training one AI model saves as much energy as 5,000 U.S. homes use in a year.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24887\" title=\"1862a866j00sob3al00qhd000nc00fkp\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/1862a866j00sob3al00qhd000nc00fkp.jpg\" alt=\"1862a866j00sob3al00qhd000nc00fkp\" width=\"840\" height=\"560\" \/><\/p>\n<p>The company explains that while data centers are connected to the outside world via fiber optic cables, copper wires are still used internally. These copper wires connect <a href=\"https:\/\/www.1ai.net\/en\/tag\/gpu\" title=\"_OTHER ORGANISER\" target=\"_blank\" >GPU<\/a> gas pedals, while GPU gas pedals spend a lot of time idle while waiting for data from other devices, consuming energy and driving up costs.<\/p>\n<p>According to Dario Gil, senior vice president and director of research at IBM, \"As generative AI demands more energy and processing power, data centers must evolve, and Co-Packaged Optics (CPO) technology can future-proof these data centers. With this breakthrough, the<strong>Chips of the future will communicate like fiber optic cables transferring data in and out of data centers<\/strong>, thereby ushering in a new era of faster, more sustainable communications capable of handling the AI workloads of the future.\"<\/p>\n<p>1AI notes that IBM outlined its new CPO prototype in a technical paper.<strong>By significantly increasing bandwidth in the data center, GPU idle time can be minimized to accelerate AI processing.<\/strong>IBM claims that training time for Large Language Models (LLMs) can be reduced from three months to three weeks. At the same time, greater energy efficiency will lower energy consumption and reduce the costs associated with training LLMs.<\/p>","protected":false},"excerpt":{"rendered":"<p>Dec. 11 (Bloomberg) -- IBM has announced the development of a new optical technology that can train AI models at the speed of light while saving significant energy. By applying this breakthrough to data centers, the company says that training one AI model saves as much energy as 5,000 U.S. homes consume in a year. The company explained that while data centers are connected to the outside world through fiber optic cables, copper wires are still used internally. These copper wires connect GPU gas pedals, which spend a lot of time idle while waiting for data from other devices, consuming energy and driving up costs. Dario Gil, senior vice president and director of research at IBM, said, \"As generative AI demands more energy and processing power, we are seeing the need for a more efficient way to do this.<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[389,415,373],"collection":[],"class_list":["post-24886","post","type-post","status-publish","format-standard","hentry","category-news","tag-ai","tag-gpu","tag-ibm"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/24886","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=24886"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/24886\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=24886"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=24886"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=24886"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=24886"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}