{"id":41986,"date":"2025-08-31T09:36:37","date_gmt":"2025-08-31T01:36:37","guid":{"rendered":"https:\/\/www.1ai.net\/?p=41986"},"modified":"2025-08-30T13:46:15","modified_gmt":"2025-08-30T05:46:15","slug":"%e9%80%9a%e4%b9%89%e4%b8%87%e7%9b%b8%e5%8d%b3%e6%a2%a6%e5%89%aa%e6%98%a0%ef%bc%8c%e9%9d%9e%e7%9c%9f%e4%ba%ba%e5%87%ba%e9%95%9c%e5%88%b6%e4%bd%9c%e5%87%ba%e5%af%b9%e5%8f%a3%e5%9e%8b%e7%9a%84%e6%95%b0","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/41986.html","title":{"rendered":"Tongyi Wanxiang+Immediate Dreaming+Silhouette, non-live action to produce lip-synced digital human videos"},"content":{"rendered":"

Made a model with the one just released by Tongyi ManphaseDigital Human<\/a>video and felt it worked out okay. I was still a little interested today, while I could still collect points, so I thought I'd do another lip-sync video.<\/p>\n

Wan2.2-S2V Released! A picture + an audio to generate cinematic digital human videos!<\/p>\n

I made a counterpart video in Tongyi Manxiang, i.e. Dreams and Cutting Reflections, respectively. But Spirit doesn't have enough points, so I'll leave it for now.<\/p>\n

AI Tools<\/strong><\/p>\n

Beanbag: https:\/\/www.doubao.com\/chat<\/p>\n

Tongyi Wanxiang: https:\/\/tongyi.aliyun.com\/wanxiang\/<\/p>\n

i.e. Dream: https:\/\/jimeng.jianying.com<\/p>\n

Cutting and Screening PC Version (SVIP)<\/p>\n

production step<\/strong><\/p>\n

In order to save points, you need to use AI tools wisely.<\/p>\n

1. Generate pictures (with beanbags)<\/strong><\/p>\n

Open the beanbag and generate the character you want. I saw a video 2 days ago of Tan Jing singing \"Jiu'er\", a national team powerhouse singer. Many years ago, it seems that Li Yu'er also sang it, and it also sounds good. So I wanted to make such a clip.<\/p>\n

It would probably take better tools and funding to sing the song entirely in digital human lip-sync and with a real-life effect.<\/p>\n

As an experience and learning experience, it's still good to just use some of the current tools.<\/p>\n

I typed into the beanbag: help me design a character who sings the song \"Jiu'er\", and I asked for a beautiful girl on the Loess Plateau, wearing a flowery cotton jacket, frontal shot<\/p>\n

\"2fbe6f66j00t1sl590014d000sc00g4p\"<\/p>\n

Next, you can make requests for beanbags based on your needs:<\/p>\n

\"c001ea5ej00t1sl5f0010d000qs00gfp\"<\/p>\n

\"fc1fbff8j00t1sl600010d000ry00f1p\"<\/p>\n

\"63439e07j00t1sl67000yd000sa00gcp\"<\/p>\n

Finally decided to go with the 1st picture:<\/p>\n

\"cb001113j00t1sl72000qd000rv00f9p\"<\/p>\n

Download watermark-free images<\/p>\n

[AI Learning] Strong push! Beanbag HD watermark-free batch download plug-in, efficient and practical!<\/p>\n

\"cf1e5f91j00t1sl7h004nd000o00156p\"<\/p>\n

2\u3001Preparing audio files<\/strong><\/p>\n

For this step, you need to prepare the audio files, you can go to the cutout and search for the music that is available inside the cutout and then export only the audio files.<\/p>\n

Note that if the digital person is generated in Tongyi Vanguard, the audio file can be exported in its entirety, as it can be automatically cropped in Tongyi Vanguard.<\/p>\n

However, if you are generating a counterpart digital person in a korin or an instant dream, the duration needs to be limited to 15s, and the longer the duration, the more points you need.<\/p>\n

In i.e. Dreams, 15s takes 75 points.<\/p>\n

The minimum number of points given away per day is 66, then you have to crop the audio. It's about 12 seconds and 60 credits would be enough. If you give away 100 points per day, then you can generate 15s of video at once.<\/p>\n

3. Generation of counterpart video clips (Tongyi Manxiang + i.e., dreaming + screen cutting)<\/strong><\/p>\n

1) The general meaning of all phases<\/p>\n

Today in Tongyi Wanxiang, the 1st generation was not so good, generated 2 times, the 2nd was significantly better, the method was mentioned in yesterday's post.<\/p>\n

\"b73da0baj00t1sl810011d000lt00h7p\"<\/p>\n

2) i.e. dreams<\/p>\n

I cropped the audio length to 13s and 65 credits, just enough to generate it once.<\/p>\n

\"727f1922j00t1sl8h0007d000fm003xp\"<\/p>\n

\"a1407c93j00t1sl8v000ud000u000jmp\"<\/p>\n

3) Cutting the movie<\/p>\n

Cutting screen, if you are SVIP members, points are enough, then you can generate a longer lip-sync video, as shown in the following picture, drag the picture to the track, and then in the screen, select [AI lip-sync], here I chose to use the audio to generate, 32s. select [Spirit Mode]. The next step is to wait patiently.<\/p>\n

\"3b9c9e85j00t1sl97000ld000av00dmp\"<\/p>\n

Waiting to be generated:<\/p>\n

\"1728db13j00t1sl9g0019d000u000dyp\"<\/p>\n

After generation is complete, the screen is cropped.<\/p>\n

\"73ee4b1ej00t1sl9n000yd000u000c7p\"<\/p>\n

You can export the generated lip-sync video before proceeding to the next step of video editing. This will require learning some editing knowledge of cut-screen.<\/p>\n

Well, that's all I have to share, so if you're interested, you can give it a try.<\/p>","protected":false},"excerpt":{"rendered":"

Made a digital man video with the model just released by Tongyi Manphase, and felt it worked fine. I'm still a little interested today, while I can still collect points, so I thought I'd make another counterpart video. Wan2.2-S2V Release! A picture + a piece of audio to generate a movie-quality digital person video! I made a lip-sync video in Tongyi Wanxiang, i.e. Dream, and Cutting Screen, respectively. But Spirit doesn't have enough points, so I'll leave it for now. AI\u5de5\u5177 \u8c46\u5305\uff1ahttps:\/\/www.doubao.com\/chat \u901a\u4e49\u4e07\u76f8\uff1ahttps:\/\/tongyi.aliyun.com\/wanxiang\/ \u5373\u68a6\uff1ahttps:\/\/jimeng.jianying.com \u526a\u6620PC\u7248\uff08SVIP\uff09\u5236\u4f5c\u6b65\u9aa4<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[149,144],"tags":[956,5321,1252],"collection":[],"class_list":{"0":"post-41986","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"hentry","6":"category-jiaocheng","7":"category-baike","8":"tag-ai","10":"tag-1252"},"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/41986","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=41986"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/41986\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=41986"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=41986"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=41986"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=41986"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}