{"id":16102,"date":"2024-07-22T09:03:00","date_gmt":"2024-07-22T01:03:00","guid":{"rendered":"https:\/\/www.1ai.net\/?p=16102"},"modified":"2024-07-22T09:03:00","modified_gmt":"2024-07-22T01:03:00","slug":"%e5%9b%be%e7%89%87%e7%94%9f%e6%88%90ai%e6%95%b0%e5%ad%97%e4%ba%ba%e8%a7%86%e9%a2%91%ef%bc%8c%e6%89%8b%e6%8a%8a%e6%89%8b%e6%95%99%e4%bd%a0%e5%a6%82%e4%bd%95%e4%bd%bf%e7%94%a8liveportrait%ef%bc%8c","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/16102.html","title":{"rendered":"Generate AI digital human videos from pictures, and teach you step by step how to use LivePortrait. No local setup is required, and it\u2019s free!"},"content":{"rendered":"

You are still waitingKeling<\/a>ofAI Video<\/a>Apply?<\/p>\n

\"get-623\"<\/div>\n

While you are waiting, read this article first.Open Source<\/a>BeLivePortrait<\/a>!<\/p>\n

This article will teach you how to use LivePortrait.No local setup required, and it\u2019s free!<\/strong><\/p>\n

Long article warning \ud83d\udea8\ud83d\udea8<\/strong><\/p>\n

First, let\u2019s learn about LivePortrait<\/strong><\/p>\n

LivePortrait is simply"Expression Migration"<\/strong>That is, provide a picture and a reference video, and through LivePortrait's AI calculation, you can replicate the facial expressions and movements of the reference video onto the picture exactly.<\/p>\n

\"get-625\"<\/div>\n

Image from LivePortrait white paper<\/p>\n

I won't go into too much detail about the complicated theoretical knowledge here.Breaking Through the Information Gap has always been based on the main operating concepts of "actual combat", "practical" and "dry goods"<\/strong>.<\/p>\n

Next, I will introduce two methods of using LivePortrait online, and you can choose according to your needs.<\/p>\n

Method 1<\/strong><\/p>\n

Huggingface<\/strong><\/p>\n

Since the outbreak of AI, Huggingface has been a leading product in the open source community. Everyone should know about it, so I won\u2019t introduce it in detail here.<\/p>\n

Huggingface online experience link:<\/p>\n

https:\/\/huggingface.co\/spaces\/KwaiVGI\/LivePortrait<\/u><\/p>\n

Select Huggingfaceadvantage<\/strong>:<\/p>\n

    \n
  • Clear interface<\/li>\n
  • Easy to operate<\/li>\n
  • Runs quickly, no need to wait too long to get results<\/li>\n
  • Has image editing function<\/li>\n<\/ul>\n

    Huggingfaceshortcoming<\/strong>:<\/p>\n

      \n
    • As an online trial experience,Cannot generate long videos<\/strong>I'm trying it out now.most<\/strong>OnlyGenerate \u2264 9 seconds<\/strong>Video.<\/li>\n
    • Video without sound<\/li>\n<\/ul>\n

      But it\u2019s enough as a trial experience!<\/p>\n

      Huggingface LivePortrait Tutorial<\/strong><\/p>\n

      \"get-624\"<\/div>\n

      Huggingface LivePortrait interface<\/p>\n

        \n
      • exist \u2460<\/strong> Upload the file you want to createpicture<\/strong>, no limit on the image ratio, 1:1, 16:9, 3:4, etc. are all OK! LivePortrait only recognizes and edits faces.<\/li>\n
      • exist \u2461<\/strong> Upload the facial movements you wantvideo<\/strong>The problem is that, as I mentioned earlier, Huggingface's LivePortrait can only produce videos of up to 9 seconds, so if your reference video is longer, you may have to make a compromise and cut out a 9-second video and upload it.<\/li>\n<\/ul>\n
        \"get-626\"<\/div>\n

        Uploaded\u2460<\/strong>and\u2461<\/strong>After that, you can click the [\ud83d\ude80Animate] button and wait for the production<\/p>\n

        exist \u2462<\/strong> You will see the single image video that has been created.<\/p>\n

        \"get-627\"<\/div>\n

        exist \u2463<\/strong> The official has thoughtfully made a comparison video for you.<\/p>\n

        \"get-631\"<\/div>\n

        If you scroll down, you will find another module.Retargeting<\/strong><\/p>\n

        Retargeting is a tool for editing facial expressions in images individually<\/p>\n

        \"get-628\"<\/div>\n

        exist \u2460<\/strong> You can adjust the degree of eye opening from 0 to 0.8. 0.8 means eyes are fully open, and 0 means eyes are closed.<\/p>\n

        exist \u2461<\/strong> You can adjust the mouth opening range at 0-0.8.<\/p>\n

        exist \u2462<\/strong> Upload the picture you want to adjust, and there is no limit on the picture ratio<\/p>\n

        exist \u2463<\/strong> At this point, the processing result of a single face can be obtained<\/p>\n

        exist \u2464<\/strong> The overall effect of the image after processing can be obtained<\/p>\n

        \"get-629\"<\/div>\n

        You can take a look at the comparison under different Ratios. The adjustment of parameters for eyes and mouth is very obvious, and it is very playable.<\/p>\n

        Method 2<\/strong><\/p>\n

        Google Colab<\/strong><\/p>\n

        This overseas expert directly put the code on Github into Google Colab, which is also an online operation.<\/p>\n

        I had never used Google Colab before, and after searching in vain, I went to Reddit and had a close conversation with a master (shamelessly asking for advice) and learned how to use LivePortrait on this Colab<\/p>\n

        Google Colab online experience link:<\/p>\n

        https:\/\/t.co\/Kn10Aqxm7R<\/u><\/p>\n

        Select Google Colabadvantage<\/strong>:<\/p>\n

          \n
        • Videos can be made and referencedEqual duration<\/strong>Videos<\/li>\n
        • The generated video directly quotes the referenceVideo and Audio<\/strong><\/li>\n<\/ul>\n

          Google Colabshortcoming<\/strong>:<\/p>\n

            \n
          • Slightly more complicated to operate<\/li>\n
          • The free version may be limited by Google GPU (if so, just come back the next day)<\/li>\n<\/ul>\n

            Google Colab LivePortrait Tutorial<\/strong><\/p>\n

            You need to prepare a Google account before using Google Colab<\/p>\n

            1. Setup<\/strong><\/p>\n

            \"get-630\"<\/div>\n

            Don\u2019t be afraid when you first enter the Colab page. It\u2019s actually not complicated at all.<\/p>\n

            Directly click the [Run Button] marked in the red box above, and the following prompt will appear<\/p>\n

            \"get-632\"<\/div>\n

            Click [Run Anyway] and Colab will automatically run the code. You don\u2019t need to worry about what happens and you don\u2019t need to do anything. It will be displayed after it finishes running, as shown in the figure below.<\/p>\n

            \"get-633\"<\/div>\n

            It will display "47 seconds" to complete. As long as your internet speed is normal, the first step of Setup will be completed within 1 minute.<\/p>\n

            2. Inference<\/strong><\/p>\n

            The second step is how to upload pictures and videos, which is the most complicated part (actually not complicated, just be patient)<\/p>\n

            \"get-634\"<\/div>\n

            When we use Colab, because it is running online, we need to upload pictures and videos to Colab. Let's take a look at the overall operation interface:<\/p>\n

            exist \u2460<\/strong> Paste the image path<\/p>\n

            exist \u2461<\/strong> Paste the path of the reference action video<\/p>\n

            exist \u2462 <\/strong>You can upload files, pictures and videos at any size, with no limit on the ratio.<\/p>\n

            So how should the file be uploaded? Where should it be uploaded to? Please see the picture below\ud83d\udc47<\/p>\n

            \"get-635\"<\/div>\n

            After clicking [Folder], search according to the following path<\/p>\n

            contact-LivePortrait-assets-examples<\/strong><\/p>\n

            You will see two folders\u3010driving\u3011<\/strong>and\u3010source\u3011<\/strong><\/p>\n

            \u3010driving\u3011Folder, used to placevideo<\/strong><\/p>\n

            [source] folder, used to placepicture<\/strong><\/p>\n

            Direct drag and drop<\/strong>You can upload files, which is very convenient.<\/p>\n

            \"get-636\"<\/div>\n

            After uploading the video\/picture, we needcopy<\/strong>Materialpath<\/strong><\/p>\n

            \"get-637\"<\/div>\n

            Select the material directly, then right-click and click\u3010Copy path\u3011<\/strong>, paste the material path into the corresponding box.<\/p>\n

            The master has put a lot of materials provided by the official Github in these two folders, and everyone can play with them directly.<\/p>\n

            After placing the material path, click the [Run button] corresponding to Inference and wait for AI calculation.<\/p>\n

            The running time of the Inference step is calculated based on the length of the video you provide. The longer the reference video is, the longer it will run.<\/p>\n

            \"get-638\"<\/div>\n

            The reference video above is 11 seconds long and has a running time of 1 minute, which is acceptable.<\/p>\n

            3. Display Result<\/strong><\/p>\n

            After the second step is completed, no video will be displayed. You need to click the [Run button] in the third step Display Result.<\/p>\n

            \"get-639\"<\/div>\n

            According to my tests, a 30-second reference video usually takes about 2 to 4 minutes to run. The usage of the cloud GPU and your own network speed at the time will also affect the running time.<\/p>\n

            I selected the same reference video (30 seconds) in Colab. Colab was able to generate the entire 30 seconds (with background sound), while Huggingface could only generate up to 9 seconds (without background sound).<\/p>\n

            Regarding the disadvantage mentioned above that "the free version may be limited by Google GPU", I personally tried it for more than a week and only encountered GPU limitations once, so you don\u2019t need to worry too much, Colab is still very stable.<\/p>\n

            Key Tips<\/strong><\/p>\n

            Currently, the online LivePortrait only supports human faces, which means that if you upload a portrait of an anthropomorphic animal, an error will be reported.<\/p>\n

            If you want to deploy LivePortrait locally yourself, you can go to the official Github homepage<\/p>\n

            Official Github homepage link:<\/p>\n

            https:\/\/github.com\/KwaiVGI\/LivePortrait<\/u><\/p>\n

            The above are two methods that allow you to use the LivePortrait feature of Keling AI video without waiting for Keling's review. My suggestion is to use the two together (they are both free anyway)<\/p>\n

             <\/p>","protected":false},"excerpt":{"rendered":"

            Are you still waiting hard for Korin's AI video application? While you're waiting, check out this article first, Racer Kerin open-sourced LivePortrait! This content shows you how to use LivePortrait by hand, with no need to build locally, and it's free! Long warning \ud83d\udea8\ud83d\udea8 First understand LivePortrait LivePortrait is simply \"expression migration\", that is, to provide a picture, a reference video, through LivePortrait's AI computing The AI algorithm of LivePortrait can then reproduce the expression movement of the reference video onto the image in its original form. Image from the LivePortrait white paper We won't go into the complexities of the theory here, after all, \"Breaking the Information Gap\" has always been the most important part of<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[149,144],"tags":[165,956,3266,2957,219,934],"collection":[],"class_list":{"0":"post-16102","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"hentry","6":"category-jiaocheng","7":"category-baike","8":"tag-ai","10":"tag-liveportrait","11":"tag-2957","12":"tag-219","13":"tag-934"},"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16102","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=16102"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/16102\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=16102"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=16102"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=16102"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=16102"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}