{"id":31321,"date":"2025-03-22T17:08:15","date_gmt":"2025-03-22T09:08:15","guid":{"rendered":"https:\/\/www.1ai.net\/?p=31321"},"modified":"2025-03-22T17:08:15","modified_gmt":"2025-03-22T09:08:15","slug":"amd-%e6%8e%a8%e5%87%ba%e5%bc%80%e6%ba%90%e9%a1%b9%e7%9b%aegaia%e5%ae%9e%e7%8e%b0%e6%9c%ac%e5%9c%b0%e5%a4%a7%e6%a8%a1%e5%9e%8b%e9%ab%98%e6%95%88%e8%bf%90%e8%a1%8c%ef%bc%9a%e9%92%88","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/31321.html","title":{"rendered":"AMD Launches Open Source Project \"GAIA\" to Enable Efficient Running of Native Large Models: Optimized for Raider AI 300 Series Processors, Currently Available Only for Windows"},"content":{"rendered":"<p>March 22 - Thursday, local time.<a href=\"https:\/\/www.1ai.net\/en\/tag\/amd\" title=\"[SEE ARTICLES WITH [AMD] LABELS]\" target=\"_blank\" >AMD<\/a> Announcing the launch of applications designed to run locally on the Large Language Model (LLM)\u00a0<a href=\"https:\/\/www.1ai.net\/en\/tag\/gaia\" title=\"_OTHER ORGANISER\" target=\"_blank\" >GAIA<\/a>(pronounced \/\u02c8\u0261a\u026a.\u0259\/) and is open-sourced on Github, and is currently limited to the Windows platform.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-31322\" title=\"2ec586c2j00stipci00igd000v900hkp\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2025\/03\/2ec586c2j00stipci00igd000v900hkp.jpg\" alt=\"2ec586c2j00stipci00igd000v900hkp\" width=\"1125\" height=\"632\" \/><\/p>\n<p>GAIA is a generative AI application that enables localized private running of LLMs on Windows PCs and is optimized for the Rui Long AI 300 series processors, marking another important placement of AMD in the edge computing space.<\/p>\n<p>Running GAIA on the NPU improves performance on AI-specific tasks. Starting with Ryzen AI software version 1.3, there is hybrid support for deploying quantized LLMs that use both the NPU and core graphics.<\/p>\n<p>Its core components are developed based on ONNX TurnkeyML's Lemonade SDK, and it adopts the Retrieval Augmented Generation (RAG) technology framework, which realizes real-time retrieval and analysis of external data such as YouTube, GitHub, and so on through local vector indexes.<\/p>\n<p>The system workflow contains three modules: LLM Connector, LlamaIndex RAG Pipeline, and Agent Web Server, which support mainstream models such as Llama and Phi. The function module contains four major AI intelligences:<\/p>\n<ul>\n<li>Chaty: a chatbot that supports historical conversations<\/li>\n<li>Clip: YouTube Video Search &amp; Q&amp;A Experts<\/li>\n<li>Joker: a joke generator with a humor style<\/li>\n<li>Simple Prompt: Model Direct Interaction Testing Tool<\/li>\n<\/ul>\n<p>On the hardware side, AMD offers two installation options: Normal and Hybrid. The regular installer is compatible with any Windows PC (including non-AMD hardware devices), and cross-platform support is realized through the Ollama backend.<\/p>\n<p>Hybrid installers are optimized for devices with the Raidon AI 300 series processors and intelligently distribute the computational load between the NPU and integrated graphics.AMD said that the Ryzen AI software has supported hybrid deployments of quantitative models between the NPU and integrated graphics since version 1.3.<\/p>\n<p>Privacy and Performance Advantage Aspects:<\/p>\n<ul>\n<li>Localized processing ensures that data from sensitive industries such as healthcare and finance does not leave the country<\/li>\n<li>Reduced response latency to milliseconds (40-60% compared to cloud-based solutions)<\/li>\n<li>NPU-specific architecture delivers performance-per-watt gains and supports offline environments<\/li>\n<\/ul>\n<p>The project uses the MIT open source protocol, and the codebase is open on GitHub. AMD specifically encourages developers to contribute custom agent modules, and several industry custom agents are currently in development.<\/p>\n<p>Additionally, while GAIA does not currently support Linux \/ macOS, official AMD documentation reveals that multi-platform support may be expanded in the future.<\/p>\n<p>1AI with Github address:<br \/>\nhttps:\/\/github.com\/amd\/gaia<\/p>","protected":false},"excerpt":{"rendered":"<p>March 22, 2011 - On Thursday, local time, AMD announced the launch of GAIA (pronounced \/\u02c8\u0261a\u026a.\u0259\/), an application designed to run Large Language Models (LLMs) locally and open-sourced on Github, which is currently limited to the Windows platform. GAIA is a generative AI application that enables localized private running of LLM on Windows PCs and is optimized for the RuiLong AI 300 series processors, marking another important step for AMD in edge computing. Running GAIA on the NPU improves performance on AI-specific tasks. Starting with Ryzen AI software version 1.3, hybrid support for deployments using both NPUs<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[333,511,2284],"collection":[],"class_list":["post-31321","post","type-post","status-publish","format-standard","hentry","category-news","tag-amd","tag-gaia","tag-2284"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/31321","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=31321"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/31321\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=31321"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=31321"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=31321"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=31321"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}