deforum-art / deforum-stable-diffusion

https://deforum.github.io/
Other
2.2k stars 386 forks source link

Please port optical flow refinements from web-ui version #255

Open AlekseyCalvin opened 1 year ago

AlekseyCalvin commented 1 year ago

Thanks for finally somewhat consolidating and neatening up the Colab developments. Would it be a major hassle to port the extended optical flow workings to the Colab version? I'm talking about the developments which brought greater integreation between the optical flow and the diffusion cadence option. I've been working on turning my friend's live action film into a set of variant animated films, and better cadence/flow integration for composite generations would make things so much easier for me. ControlNet could be nice too, but the cadence/flow thing seems like it would be much easier to port/implement here, as well as more universally useful, at least at the get-go.

On a side note, I'm aware the Deforum development focus has been on the Web-ui Extension version, and the notebook alternative has been largely treated as a legacy version. I find that a bit unnerving. I'm sure I'm not the only one among long-time deforum artists who hates using the Web-Ui and avoids doing so at all costs. After all, if one has an ongoing Deforum-based project accessed via multiple devices, why must one subject themselves to the hulking, overcentralized (ever-scattering) Web-ui setup, not to mention its unreliable launch/update procedures and undercentralized (ever-fragmenting) and all-too-slow windowy workflows? I personally find the UI extremely awkward. Since Deforum first launched, I've used it all the time, towards many hundreds of animations and numerous projects, and the notebook workflow is where I feel most comfortable and adept. It is the notebook where I can easily copy/paste setting-code snippets, work largely in one window, easily migrate devices and contexts, continuously experiment over the foundations of some fair reliability, and save old workflows/settings as separate notebooks to be easily relaunched all at once. There are other benefits too. But I hope I've already made enough of a point. Thank you so much for all of your work thus far! (And by "your" I mean the whole active collective) And I do very much hope you do take this particular testimonial and suggestion into consideration moving forward.

deforum commented 1 year ago

I am the only person maintaining the repo currently - i will try my best