search

volotat / SD-CN-Animation

This script allows to automate video stylization task using StableDiffusion and ControlNet.
MIT License
806 stars 61 forks source link

Question: generate using only openpose #139

Open zba opened 1 year ago

zba commented 1 year ago

in vid2vid if, the source video is on white background (as much of dance videos) resulting image is overburn (no any antiburn tricks works) , is it possible (making sense?) to ignore all video image and just send it to openpose preprocessor and render based just on detected poses, or poses and prev frame of rendered, but not original at all ? Shorter question - can we ignore original video gamma ?

aulerius commented 1 year ago

I'd also be interested in this, Functionality to separate video data and motion data, make them modular, allowing to disable either or switch with another (import previously used, or generated from 3D renders). Also talked on #130

zba commented 1 year ago

so we need a checkbox like "use only controlnet" ? I lame in python, but may be can try to implement it,

Ainaemaet commented 1 year ago

@zba thanks for being as attentive to our requests as you have been and are, I've seen so many popular extensions fall by the wayside and it's awesome what you're doing.

Worlds above any of the other _to_video extensions projects out there!

moltea commented 1 year ago

Now I decided to use this extension, and it seems to me that it is really important to add a checkbox like "use only controlnet", because the tile is not always suitable for the request/prompt