{"id":8394,"date":"2024-04-18T10:24:25","date_gmt":"2024-04-18T02:24:25","guid":{"rendered":"https:\/\/www.1ai.net\/?p=8394"},"modified":"2024-04-18T10:24:25","modified_gmt":"2024-04-18T02:24:25","slug":"%e5%85%8d%e8%b4%b9%e7%94%9f%e6%88%90%e4%b8%8d%e9%99%90%e6%97%b6%e9%95%bf%e7%9a%84ai%e6%95%b0%e5%ad%97%e4%ba%ba%ef%bc%8c%e8%85%be%e8%ae%af%e5%bc%80%e6%ba%90%e9%a1%b9%e7%9b%aemusev%e6%9c%ac%e5%9c%b0","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/8394.html","title":{"rendered":"Free generation of AI digital people for unlimited time, detailed local deployment of Tencent open source project MuseV"},"content":{"rendered":"

Tencent<\/a>Its Tianqin Laboratory has just been open sourcedAI Digital Human<\/a>MuseV<\/a>The full name of the project is: MuseV: Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising. MuseV and its later released MuseTalk video lip sync are a complete AI digital human solution. With the open source of these two projects, we can create AI digital humans of unlimited length for free.<\/p>\n

Project Features<\/strong><\/p>\n

1. No time limit<\/p>\n

2. Text to Video Generation<\/p>\n

3. Video to video generation<\/p>\n

4. Compatible with the Stable Diffusion ecosystem, including basic models, Lora, Controlnet, etc.<\/p>\n

5.Support multiple reference image technologies, such as IPAdapter, ReferenceOnly, IPAdapterFaceID, etc.<\/p>\n

How to use<\/strong><\/p>\n

Currently MuseVOpen Source Projects<\/a>There are four ways to use it.<\/p>\n

1. Clone and deploy by yourself according to the technical instructions.<\/p>\n

Project address:github.com\/tmelyralab\/musev<\/a><\/p>\n

2. The official has launched a demo trial on the Hug Face.<\/p>\n

Demo address:huggingface.co\/spaces\/AnchorFake\/MuseVDemo<\/a><\/p>\n

3. One-click operation for local deployment on Windows. This is a one-click operation integrated package made by the master "Crossfish" of Station B. You can directly download and unzip it to run it with one click.<\/p>\n

Network disk address:https:\/\/www.123pan.com\/s\/Pf5Yjv-Bb9W3.html<\/a><\/p>\n

Extraction code: glut<\/p>\n

There are two files in the network disk, the other one is MuseTalk. After downloading, unzip the MuseV file, and then click the "01 Run Program" file.<\/p>\n

\"get-568\"<\/div>\n

Except for the Video Length, other parameters can remain unchanged. The default is 6 frames per second and a duration of 12, which means a 2-second video will be generated.<\/p>\n

The default W&H is -1, using the size of the reference image. The size of the target video is (W, H). The shorter the image size, the greater the motion and the lower the video quality. The longer W&H, the smaller the motion and the higher the video quality.<\/p>\n

Note: It is best to put it in a folder with all letters on the C drive; turn on Magic Network before running, because several models will be downloaded automatically; graphics card with 12G video memory or above, the larger the better.<\/p>\n

4.SD Comfyui runs.<\/p>\n

Search for "MuseV" on the Install Node page in the manager and click Install<\/p>\n

\"get-569\"<\/div>\n

Download the workflow and import it into Comfyui.<\/p>\n

\"get-570\"<\/div>\n
\"get-571\"<\/div>\n

Workflow download address:github.com\/chaojie\/ComfyUI-MuseV<\/a><\/p>\n

Overall, the effect is good. Currently, there are very few controllable parts. The larger the image, the smaller the movement. It is recommended not to exceed 1024. The larger the image, the more video memory is consumed and the longer it takes. It took me more than an hour to generate a 1024*1536 10-second video using a 2080Ti 22G video memory. I will talk about another MuseTalk lip alignment project next time, which is more fun.<\/p>","protected":false},"excerpt":{"rendered":"

Tencent's Tianqin Labs has just open-sourced the AI digital human MuseV project, the full name of which is: Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising (MuseV: Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising). MuseV and its later released MuseTalk Video Lip Synchronization are a complete AI digital human solution. With the open source of these two projects we can make unlimited AI digital human for free. Project features 1. Unlimited time<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[149,144],"tags":[165,2285,2284,323],"collection":[],"class_list":["post-8394","post","type-post","status-publish","format-standard","hentry","category-jiaocheng","category-baike","tag-ai","tag-musev","tag-2284","tag-323"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/8394","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=8394"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/8394\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=8394"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=8394"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=8394"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=8394"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}