toshiaki1729 / stable-diffusion-webui-dataset-tag-editor

Extension to edit dataset captions for SD web UI by AUTOMATIC1111
MIT License
661 stars 57 forks source link

[Feature Request] Parallel processing for Interrogators #55

Open toshiaki1729 opened 1 year ago

toshiaki1729 commented 1 year ago
when loading, does it actually interrogate in batches, or does it interrogate as a foreach? it doesnt stress any components of my computer, so it doesnt appear to be running in parallel, which is where I think lijt is coming from. if I want to interrogate 5000 images, I start it in the morning and its done a little after I get off work. I could lower the resolution to get it to run faster, but that means that details will not be interrogated and lowers the accuracy of the resultant tags.

Originally posted by @yggdrasil75 in https://github.com/toshiaki1729/stable-diffusion-webui-dataset-tag-editor/issues/51#issuecomment-1460035620

toshiaki1729 commented 1 year ago
the interrogator model not supporting batching aside, can you run multiple instances of the interrogator at once to effectively batch process? it would be slower than running 1 instance of the interrogator as a single native batch process probably, but it would still be faster than 1 at a time.

Originally posted by @yggdrasil75 in https://github.com/toshiaki1729/stable-diffusion-webui-dataset-tag-editor/issues/51#issuecomment-1460271682

toshiaki1729 commented 2 months ago

partiially supported In standalone version

toshiaki1729 commented 2 months ago

i will import the change in standalone ver if possible