KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
13.11k stars 1.39k forks source link

audio2face or opencv combine LivePortrait? #152

Open lonngxiang opened 4 months ago

lonngxiang commented 4 months ago

audio2face or opencv drives LivePortrait in real time. Can this idea be realized in real time

Mrkomiljon commented 4 months ago

@lonngxiang I am currently working on it. You can see it in here

https://github.com/user-attachments/assets/aaca6a7a-d46b-444e-af8e-e02a3504eb43

Please check it!!! https://github.com/Mrkomiljon/Live_Portrait_Monitor

https://github.com/Mrkomiljon/Webcam_Live_Portrait

lonngxiang commented 4 months ago

@lonngxiang I am currently working on it. You can see it in here

video6105138957194890678.mp4 Please check it!!! https://github.com/Mrkomiljon/Live_Portrait_Monitor

https://github.com/Mrkomiljon/Webcam_Live_Portrait

https://github.com/Mrkomiljon/Webcam_Live_Portrait

run error:python app.py --server_name "0.0.0.0"

File "/home/anaconda3/envs/aigc/lib/python3.10/site-packages/gradio/utils.py", line 816, in wrapper response = f(*args, **kwargs) File "/ai/Webcam_Live_Portrait/src/gradio_pipeline.py", line 63, in execute_video video_path, video_path_concat = self.execute(self.args) AttributeError: 'GradioPipeline' object has no attribute 'execute' ^CKeyboard interruption in main thread... closing server.

Mrkomiljon commented 4 months ago

@lonngxiang you have to run for webcam inference: python inference.py -s assets/examples/source/your_photo.jpg

isloj16 commented 2 months ago

@lonngxiang I am currently working on it. You can see it in here

video6105138957194890678.mp4 Please check it!!! https://github.com/Mrkomiljon/Live_Portrait_Monitor

https://github.com/Mrkomiljon/Webcam_Live_Portrait

its not working properly.

i tried so many times to see if it was from my end, but its not. the photo animation from live webcam always appear distorted.