divamgupta / diffusionbee-stable-diffusion-ui

Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.
https://diffusionbee.com
GNU Affero General Public License v3.0
12.45k stars 612 forks source link

Keep the loaded model in memory #538

Open wojciechkrol opened 1 month ago

wojciechkrol commented 1 month ago

It seems that each image generation process involves loading the model into memory (flux model), generating the image, and then releasing the model from memory. Loading takes some time, and when you want to generate many images, a lot of time is wasted on just loading.

Is it possible to load the model into memory right after selecting it and keep it there until the program is closed?