kabachuha / sd-webui-text2video

Auto1111 extension implementing text2video diffusion models (like ModelScope or VideoCrafter) using only Auto1111 webui dependencies
Other
1.28k stars 107 forks source link

[Feature Request]: Add color correction #99

Closed kabachuha closed 1 year ago

kabachuha commented 1 year ago

Is there an existing issue for this?

What would your feature do ?

The generated videos are too grayish in their colors, possibly due to training on stock footage. To counter this withering out, it may be possible to add a sample image and provide a richer color palette. Even better if it's applied during the generation, so it will have an actual effect on the model's decision making process.

Proposed workflow

  1. Go to one of the tabs
  2. Press Enable color correction
  3. Add a sample image
  4. The color histogram is transferred to the video, even better if during the sampling

Additional information

See Auto1111's sd webui for reference

kabachuha commented 1 year ago

Better use with ControlNet support