Keep model in ram until I press unload button or switch models

DEVAIEXP / image-interrogator

The IMAGE-interrogator for SOTA image captioning

MIT License

77 stars 5 forks source link

Keep model in ram until I press unload button or switch models #11

Closed Vigilence closed 6 months ago

Vigilence commented 7 months ago

Is your feature request related to a problem? Please describe. I did some testing of single image and noticed that the cogvlm model unloads after it does a caption. Is there any chance we can get a setting that keeps the model in the ram until we switch models or unload it via a button?

Describe the solution you'd like Keep model in ram until I press unload button or switch models

elismasilva commented 7 months ago

I will check if it is possible to make this adjustment for a next version. Thank you!

Vigilence commented 7 months ago

Thank you so much!

elismasilva commented 6 months ago

Fixed in release v1.0.1