pharmapsychotic / clip-interrogator

Image to prompt with BLIP and CLIP
MIT License
2.58k stars 429 forks source link

How to set lowvram mode on via settings? #107

Open stubkan opened 7 months ago

stubkan commented 7 months ago

The main readme.md says this

On systems with low VRAM you can call config.apply_low_vram_defaults() to reduce the amount of VRAM needed (at the cost of some speed and quality). The default settings use about 6.3GB of VRAM and the low VRAM settings use about 2.7GB.

But I have no idea how to do that. I dont know how to pass the --vram argument because Im using a framework to run the clip interrogator through another script

The closest I've figured out is that Config appears to be set in the clip_interrogator.py file, and is called from there, and I can see this section of it

    def apply_low_vram_defaults(self):
        self.caption_model_name = 'blip-base'
        self.caption_offload = True
        self.clip_offload = True
        self.chunk_size = 1024
        self.flavor_intermediate_count = 1024

Which looks like the settings for low vram mode, I can't see any lowvram disable or enable variable anywhere, or know where to insert one. How do I "call config.apply_low_vram_defaults()" ?

I'm just going to edit the main settings to be like those vars in low_vram, ie, setting chunk size to 1024 instead of 2048 etc, and it works with 6GB VRAM for now