volotat / SD-CN-Animation

This script allows to automate video stylization task using StableDiffusion and ControlNet.
MIT License
806 stars 61 forks source link

How to use video 2 video to generate an effect like watercolor #116

Closed Websteria closed 1 year ago

Websteria commented 1 year ago

When I try to do a video to video with the prompt watercolor painting, it seems like the video is mostly SD trying to find watercolor paintings in my video. It does not take the video and make it look like all the samples I've seen. Anyone else had this experience? This is 8 frames in. Frame one is a straight up painting that has nothing to do with the video at all. 00008

volotat commented 1 year ago

Please check out this examples: https://drive.google.com/drive/folders/1eFz7A6yBcX10yM_3-sKjbvVdcjGiHras many of these demos contains exact parameters used to create them. I hope it will help.