only using 10% of my gpu

[nicolai256]

hello, I managed to get the new interrogator to run locally but it only uses a fraction of my gpu power (10%) any way to optimize this? I'm trying to caption my database that has millions of images so it would be nice if it could be optimized. thanks 😄

[pharmapsychotic]

I'm definitely interested in optimizing it! The 2.0 version moved to precomputed embeddings and a few other nice speed ups. I have a bunch of ideas for speeding up "best" mode. You can try using the "fast" mode (interrogate_fast) which is like 1 second per image. It doesn't give alignments as close as best though.

[nicolai256]

I'm definitely interested in optimizing it! The 2.0 version moved to precomputed embeddings and a few other nice speed ups. I have a bunch of ideas for speeding up "best" mode. You can try using the "fast" mode (interrogate_fast) which is like 1 second per image. It doesn't give alignments as close as best though.

I'm gonna try running it 7 times at once tomorrow maybe that'll work :) maybe there's a way to do that with this code, something like batch size or whatever

[nicolai256]

by the way, the interrogator is really good, nicely done. best one I've used so far 😄

[nicolai256]

My python skills are not advanced enough to figure out multiprocessing with listdir 😅 I figured out how to skip already done captions but that doesn't seem to have any effect on multiprocessing, great for resuming though

[xxl2005]

hello, I managed to get the new interrogator to run locally but it only uses a fraction of my gpu power (10%) any way to optimize this? I'm trying to caption my database that has millions of images so it would be nice if it could be optimized. thanks smile

can you explain to me how you managed to run local. how to install?