s9roll7 / animatediff-cli-prompt-travel

animatediff prompt travel
Apache License 2.0
1.17k stars 105 forks source link

No consistency between frames and bad images #238

Closed DaLizardWizard closed 4 months ago

DaLizardWizard commented 4 months ago

This is what the frames look like in my outputs folder when using the example images provided

image

I am using stable diffusion v 1.5, with the motion 1.5v2 model along with canny edge detection.

Has anyone seen this before?

prompt_travel.json

DaLizardWizard commented 4 months ago

00_341774366206100_masterpiece_best-quality_a-beautiful-and-detailed- This is what I get as an output where there is no smooth frames

AivoGenX commented 4 months ago

I don't understand what you're saying. Do you need to create images with continuous changes

DaLizardWizard commented 4 months ago

No I want the frames to be smooth, but I seem to be getting no smoothness or latent space interpolation using the command. I am using the motion module 1.5v2. I have disabled all controlnet options apart from canny edge.

animatediff generate -c config/prompts/prompt_travel.json -W 512 -H 768 -L 128 -C 16

DaLizardWizard commented 4 months ago

Solved, Both a mixture of using the wrong motion module. Now using the correct motion module v2