search

KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
12.99k stars 1.38k forks source link

Sound in LivePortrait Vid to Vid - 1st version #406

Open reefor opened 1 month ago

reefor commented 1 month ago

Hi. I just started using this and I'm still pretty new to anything outside of windows. But I learn very fast.

I'm using Comfyui and just installed and tested the first version of Liveportrait Vid 2 Vid last night wit your workflow and for some reason it wouldn't allow me to connect the audio from the driving video.

I let Comfyui install all the missing nodes. I used the pip for the pretrained weights, it put them on my users folder. I click and dragged them into the right place I think - it would be nice if the tree you listed had a few more steps listed so I can be sure the folders are in the right place. But everything else seems be working fine so I think I got it right.

I'm not sure why it's not connected to begin with in your workflow. Is it not working?

When I click and drag from the video input node to the combine it just won't connect, also won't connect from I click and drag from the combine to the video input node.

Is there another node that I need to install that should go between those 2 nodes maybe?

Any suggestions would be helpful, or if I haven't given enough information above, maybe you can post another workflow with it already connected so I can test it and let you know if that fixes the problem.

Thanks for any & all help.

reefor commented 1 month ago

Update: I did some digging and saw a post that says the audio from the driving video will be automatically included in the finished video. Again, sorry for being such a noob but it took me a while to find that post. I assume that means we don't have to connect the audio from the driving video & combine nodes. (Please tell me if I'm wrong)

In the same thread, someone not running windows said that they had to copy FFMPEG & FFPROBE into the root directory of Liveportrait. Do I also have to do that on a Windows PC, or as long as I have them in the following location, is it OK? C:\FFmpeg\bin

reefor commented 1 month ago

Another Update:

I tested it and got no sound. So I went looking for nodes and the only audio node I saw with both an input and output was "Audio to Legacy VHS Video". So I put it out and tried feeding it from the Driving Video & connecting it to the Video Combine and got a warning message, said there was some other node I needed to decode VHS. I deleted that node and now it connects directly. I have no idea why. But the sound is working as well.

If I have anyone's attention. I saw in a video a while back that the program keeps things in memory using vram & I can switch if off to save my vram --> I only have 6 gig. Can't remember where that switch is. I turned off "keep model loaded" in the 2 croppers but that doesn't seem to be it. Can someone tell me where that switch is because I can't find it.

ai-anchorite commented 1 month ago

hi there. You're after the comfyui LivePortrait implementation by Kijai.

https://github.com/kijai/ComfyUI-LivePortraitKJ

reefor commented 1 month ago

Thanks, I didn't realize there were 2 versions. Is there a difference between the 2?