search

light-and-ray / sd-webui-replacer

A tab for sd-webui for replacing objects in pictures or videos using detection prompt
196 stars 11 forks source link

Add video support #11

Closed fsdadsafadfs closed 8 months ago

light-and-ray commented 8 months ago

Looks okay. I need to test and do little code style fixes. (Remove debugging prints, and move big connected with video functions in separated file)

How is it consistent? For my experience any video generation in stable diffusion is flickering and inconsistent. The exception is only animate diff. Did you see this problem here, in inpainting?

fsdadsafadfs commented 8 months ago

it does flicker a lot :( feel free to modify, it's just a quick hack to accept and generate video, would work ok (still flicker a bit) if the POV of the video is consistent (static, not much motion). this is my first attempt to create an extension, i'm still not sure how to handle the "temporary" frames generated before creating a video.

light-and-ray commented 8 months ago

Here is my patch https://github.com/light-and-ray/sd-webui-replacer/commit/685bc2d1a06be7ba4b17fc984e40726b9c8b7ff8

Yes, it flickers. But let it be With https://github.com/light-and-ray/sd-webui-lama-cleaner-masked-content and low denoising it looks a bit better