Detectmaps still breaking during batch process

[Enferlain]

I think it used to break on the first image of a sequence a few weeks ago, now it breaks after around 5 or 6. So far tried depth leres, canny, and hed, all get corrupted, resulting in unusable detectmaps and warped images.

canny

hed

Settings used

[ljleb]

Try the latest version and see if it fixes the problem.

[Enferlain]

Good idea, thanks.

[Enferlain]

Alright I updated to latest, detectmaps are broken from the first processing. Version 5d387abf (Thu May 4 02:03:32 2023)

Loading model from cache: control_v11f1p_sd15_depth_fp16 [4b72d323]
Loading preprocessor: depth_leres++
Pixel Perfect Mode Enabled.
resize_mode = ResizeMode.INNER_FIT
raw_H = 219
raw_W = 390
target_H = 432
target_W = 768
estimation = 432.0
preprocessor resolution = 448

[Enferlain]

Updated to latest, still happens.

python: 3.10.11  •  torch: 2.0.0+cu118  •  xformers: 0.0.19  •  gradio: 3.23.0  •  commit: [22bcc7be] controlnet ver c9c8ca6e (Sun May 7 17:15:00 2023)

Can someone pls help me test this if it only happens for me?

[Enferlain]

I asked someone to try on a normal colab runtime and it works for them. Any idea why it being run off of drive would cause issues? Since that's the only difference. Gonna try a few other notebooks to check, but if any of them work then it's guaranteed to be because of my install being ran off of drive.

Ok, it wasn't just me. I'm testing on one of Camenduru's colab notebooks, and the same issue is present, so it's not related to running from drive. Gonna ask him as well to try and look into it

Camenduru linked me a public link from a notebook he was running. Same settings as me, but for him it worked. I tried on a different browser just in case because previously I've seen brave not working with controlnet, but that wasn't it. Unless opera gx also doesn't work.

Tried renaming the files, renaming the folders, moving the folders, didn't work. Tried deleting stuff from extensions/controlnet/annotator/openpose, that doesn't do anything and openpose still works fine on its own outside of batch, so not really sure what those files even do. Gonna try some more stuff tomorrow like disabling adblockers and stuff like that

One last observation before bed, a lot of images randomly give blank openpose detectmaps (not the ones I'm trying in batch, those work on their own.) Not sure if anyone reported this before but there it is.

[Enferlain]

Ok, my current guess is that ez-gif splits into frames with barely visible artifacts because of shit quality encoding and using controlnet on them results in fried detectmaps. Tried with some normal images and it was fine.

Gonna split with something else, if it works I'll be closing this finally

Used ffmpeg, works perfectly. Should've thought about it before, but on their own the frames worked well with controlnet, it was only in batch when they turned scuffed.