volotat / SD-CN-Animation

This script allows to automate video stylization task using StableDiffusion and ControlNet.
MIT License
807 stars 61 forks source link

Output is all messed up #205

Open nitinmukesh opened 4 months ago

nitinmukesh commented 4 months ago

Do I am using this with Automatic1111 and using the following steps

  1. use txt2image to generate the image and use the fixed seed from there
  2. Select the video (https://www.pexels.com/video/a-cute-girl-blowing-a-kiss-3682816/)
  3. W=576 and H=1024
  4. CFG scale = 5.5
  5. Processing strength (Step 1) = 0.85
  6. Fix frame strength (Step 2) = 0.15
  7. Sampling method = DPM++ 2M Karras
  8. Sampling steps = 50

Prompt realistic, photo-realistic:1.3), masterpiece, an extremely delicate and beautiful, extremely detailed, CG, unity , Amazing, finely detail, light smile, extremely detailed CG unity 8k wallpaper, huge filesize, ultra-detailed, highres, absurdres, soft light, (((medium hair:1.3), short bang, pink hair, floating hair novafrogstyle)), beautiful detailed girl, detailed fingers, extremely detailed eyes and face, beautiful detailed nose, beautiful detailed eyes, long eyelashes, light on face, looking at viewer, 1girl, cute, young, mature face, (full body:1.3), ((small breasts)), realistic face, realistic body, beautiful detailed thigh, , business suit, cross-laced clothes, collared shirt, open clothes, black thighhighs, miniskirt, black underwear, unbuttoned shirt,

Negative paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, ((monochrome)), ((grayscale)), skin spots, acnes, skin blemishes, age spot, glans, extra fingers, fewer fingers, ((watermark:2)), (white letters:1), (multi nipples), bad anatomy, bad hands, text, error, missing fingers, missing arms, missing legs, extra digit, fewer digits, cropped, worst quality, jpeg artifacts, signature, watermark, username, bad feet, {Multiple people}, blurry, poorly drawn hands, poorly drawn face, mutation, deformed, extra limbs, extra arms, extra legs, malformed limbs, fused fingers, too many fingers, long neck, cross-eyed, mutated hands, polar lowres, bad body, bad proportions, gross proportions, wrong feet bottom render, abdominal stretch, briefs, knickers, kecks, thong, {{fused fingers}}, {{bad body}}, bad-picture-chill-75v, ng_deepnegative_v1_75t, EasyNegative, bad proportion body to legs, wrong toes, extra toes, missing toes, weird toes, 2 body, 2 pussy, 2 upper, 2 lower, 2 head, 3 hand, 3 feet, extra long leg, super long leg, mirrored image, mirrored noise, (bad_prompt_version2:0.8), aged up, old, nude, naked,

The first frame generated is awesome and rest all messed up. Any ideas 00001 00002 00003 00004 00005 00006 00007 00008 00009 00010