search

Zejun-Yang / AniPortrait

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
Apache License 2.0
4.6k stars 576 forks source link

Issue about flickers in generated videos #113

Open 2502128021 opened 6 months ago

2502128021 commented 6 months ago 
          Thank you for your interest! The flickering issue may be attributed to the diffusion model, and we are actively working to address this in the future.

Originally posted by @Zejun-Yang in https://github.com/Zejun-Yang/AniPortrait/issues/20#issuecomment-2024496649

Have u found any clues about the cause of flicker?

Zejun-Yang commented 6 months ago

Using optical flow to smooth video frames can help alleviate this issue.

2502128021 commented 6 months ago

I'm confused, it seems your work is similar to Animateanyone especially in the generation part (diffusion model), but little flickers observed in thier result (since Ali not released their official code, I test Moore's code). Have u think about the difference between your work and theirs ? is that because of not enough training?

SurrealEverything commented 2 months ago

I'm confused, it seems your work is similar to Animateanyone especially in the generation part (diffusion model), but little flickers observed in thier result (since Ali not released their official code, I test Moore's code). Have u think about the difference between your work and theirs ? is that because of not enough training?

I have the same question about the reason for the flickering