{"id":3389,"date":"2024-01-30T10:08:56","date_gmt":"2024-01-30T02:08:56","guid":{"rendered":"https:\/\/www.1ai.net\/?p=3389"},"modified":"2024-01-30T10:08:56","modified_gmt":"2024-01-30T02:08:56","slug":"luna-ai%ef%bc%9a%e4%b8%80%e5%a5%97%e5%85%a8%e8%87%aa%e5%8a%a8ai%e7%9b%b4%e6%92%ad%e7%b3%bb%e7%bb%9f%ef%bc%8c%e7%9c%9f%e6%ad%a3%e7%9a%84%e8%90%bd%e5%9c%b0%e5%8f%98%e7%8e%b0%e5%bc%80%e6%ba%90%e9%a1%b9","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/3389.html","title":{"rendered":"Luna AI: A fully automatic AI live broadcast system, a real open source project"},"content":{"rendered":"<p><a><a href=\"https:\/\/www.1ai.net\/en\/tag\/luna-ai\" title=\"[See articles with [Luna AI] label]\" target=\"_blank\" >Luna AI<\/a><i class=\"wx_search_keyword\"><\/i><\/a>Is an advanced fully automatic<a href=\"https:\/\/www.1ai.net\/en\/tag\/ai%e7%9b%b4%e6%92%ad%e7%b3%bb%e7%bb%9f\" title=\"[SEES ARTICLES WITH [AI LIVE SYSTEM] LABELS]\" target=\"_blank\" >AI Live Broadcast System<\/a>, combines multiple AI technologies such as ChatterBot, GPT, Claude, etc., and supports local and cloud operation. Using Live2D and UE5 technology, it can be used as<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e8%99%9a%e6%8b%9f%e4%b8%bb%e6%92%ad\" title=\"[Sees articles with labels]\" target=\"_blank\" >Virtual Anchor<\/a>Live interactive broadcasts on platforms such as Bilibili and Douyin, or chat with users locally. The system integrates natural language processing and text-to-speech technologies such as Edge-TTS and VITS-Fast to provide a rich interactive experience. In addition, Luna AI also supports Stable Diffusion drawing functions to add interactive fun to live broadcasts. The project has a clear structure, including configuration files, GUI main programs, and multiple functional folders, and is suitable for multiple operating systems.<\/p>\n<section>\n<section>\n<section><strong>Virtual anchors and real-time interaction<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<section>\n<section>Using Live2D, Vtube Studio, UE5 and Audio2Face technology, Luna AI can appear as a virtual anchor on live broadcast platforms such as Bilibili, Douyin, Kuaishou, and Douyu. These technologies give the virtual anchor a realistic appearance and expressions, which can attract viewers and provide an immersive viewing experience.<\/section>\n<section><\/section>\n<\/section>\n<section>\n<section>\n<section>\n<section><strong>Natural Language Processing and Text-to-Speech<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<\/section>\n<section>\n<section>The project uses a variety of natural language processing and text-to-speech technologies, such as Edge-TTS, VITS-Fast, elevenlabs, bark-gui, and VALL-EX, to generate responses to audience questions. These technologies allow Luna AI to interact with the audience in a natural and fluent way. At the same time, so-vits-svc and DDSP-SVC provide voice-changing functions, which increase the diversity and fun of live broadcasts.<\/section>\n<section><\/section>\n<\/section>\n<section>\n<section>\n<section>\n<section><strong>Drawing function<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<\/section>\n<section>\n<section>Through specific instructions, Luna AI can collaborate with Stable Diffusion to display paintings. This function not only increases the interactivity of the live broadcast, but also provides visual enjoyment for the audience.<\/section>\n<section><\/section>\n<\/section>\n<section>\n<section>\n<section>\n<section><strong>Technology and framework integration<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<\/section>\n<section>Luna AI integrates many AI technologies and frameworks, including but not limited to ChatterBot (a library for building chatbots), GPT (a powerful text generation model), Claude (a versatile AI language model), langchain (for building and running language chains), chatglm (a chat model based on GPT), text-generation-webui (a front-end interface for text generation), iFlytek Spark (providing speech recognition and synthesis services), and Zhipu AI (providing AI-related services and technologies). The combination of these technologies makes Luna AI extremely powerful in language processing and response.<\/section>\n<section><\/section>\n<section>\n<section><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3390\" title=\"640-99\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/01\/640-99.png\" alt=\"640-99\" width=\"1080\" height=\"801\" \/><\/section>\n<\/section>\n<section>\n<section>\n<section>\n<section><strong>Project Structure<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<\/section>\n<section>\n<section>The project contains several important folders and files:<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>config.json: Configuration file that stores all settings and options.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>main.py: GUI main program, which calls each platform program according to the configuration.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>utils folder: contains the encapsulation implementation of chat, audio, and general class related functions.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>data folder: stores data files, banned words, text, etc.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>log folder: stores operation logs, subtitle logs, etc.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>out folder: stores audio files output by TTS and SVC, and audio files output by text.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>Live2D folder: stores Live2D source code and models.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>song folder: stores songs in song request mode.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>docs folder: stores project related documents.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>tests folder: stores test programs for single functional points.<\/section>\n<section><\/section>\n<section><strong>\u00b7<\/strong>Cookie folder: stores cookie data required for some functions.<\/section>\n<section><\/section>\n<\/section>\n<section>\n<section>\n<section>\n<section><strong>Environmental requirements and installation<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<\/section>\n<section>\n<section>Luna AI supports Windows 7 and above, MacOS, and Linux operating systems. The project uses Python 3.10.11, and all dependent libraries are listed in requirements.txt. When installing, be careful to avoid using Chinese paths, spaces, and special characters to avoid causing program operation abnormalities.<\/section>\n<section><\/section>\n<\/section>\n<section>\n<section>\n<section>\n<section><strong>Configuration and Customization<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<\/section>\n<section>\n<section>The project provides a GUI interface for configuring and customizing various functions. You will see the specific configuration content in the configuration file config.json.<\/section>\n<section><\/section>\n<\/section>\n<section>\n<section>\n<section>\n<section><strong>Project Link<\/strong><\/p>\n<\/section>\n<\/section>\n<\/section>\n<\/section>\n<section>\n<section><span class=\"wx_text_underline\">https:\/\/github.com\/0x648\/luna-ai<\/span><\/section>\n<\/section>","protected":false},"excerpt":{"rendered":"<p>Luna AI is an advanced fully automated AI live streaming system that combines various AI technologies such as ChatterBot, GPT, Claude, etc. and supports both local and cloud operation. Utilizing Live2D and UE5 technologies, it is capable of acting as a virtual anchor for real-time interactive live streaming on platforms such as Bilibili and Jieyin, or chatting with users locally. The system integrates natural language processing and text-to-speech technologies such as Edge-TTS and VITS-Fast to provide a rich interactive experience. In addition, Luna AI supports Stable Diffusion mapping to add interactive fun to live broadcasts. The project has a clear structure, including configuration files, a main GUI program, and multiple functional folders for multiple operating systems. Virtual<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[144],"tags":[1083,1082,1084],"collection":[],"class_list":["post-3389","post","type-post","status-publish","format-standard","hentry","category-baike","tag-ai","tag-luna-ai","tag-1084"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/3389","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=3389"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/3389\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=3389"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=3389"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=3389"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=3389"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}