deforum-art / sd-webui-deforum

Deforum extension for AUTOMATIC1111's Stable Diffusion webui
https://deforum.github.io
Other
2.64k stars 383 forks source link

[Feature Request]: Deflickering? "Blind Video Deflickering by Neural Filtering with a Flawed Atlas" #488

Closed ryan94420 closed 1 year ago

ryan94420 commented 1 year ago

Is there an existing issue for this?

What would your feature do ?

Not sure if this is already being worked on or if there is already a extension I haven't come across anything yet

Blind Video Deflickering by Neural Filtering with a Flawed Atlas Chenyang Lei, Xuanchi Ren, Zhaoxiang Zhang and Qifeng Chen CVPR 2023 "Potential applications: Our model can be applied to all evaluated types of flickering videos. Besides, while our approach is designed for videos, it is possible to apply Blind Deflickering for other tasks (e.g., novel view synthesis) where flickering artifacts exist."

Proposed workflow

  1. Go to neural filtering tab choose file, some sliders for tweaking the config file settings
  2. possible improvements to size of video or to automatically cut and batch run to make longer videos
  3. Press filter

Additional information

https://chenyanglei.github.io/deflicker/CVPR2023_deflicker_lowres.pdf

Are you going to help adding it?

not sure I'm much help

hithereai commented 1 year ago

It runs super slow, and have troubles handling more than than 100-200 frames. Not sure at this stage it's a good idea to add.

Been testing it already.