search

kijai / ComfyUI-moondream

ComfyUI node to use the moondream tiny vision language model
89 stars 13 forks source link

memory persistance #4

Open Kwisss opened 6 months ago

Kwisss commented 6 months ago

why does the moondream model not unload when done processing? ksampler takes 3 times as long when I use it. And when I look in task manager the memory on my gpu exceeds the dedicated memory and starts to fill the shared memory which is significantly slower.

I'm on ComfyUI Revision: 2052 [55f37baa] | Released on '2024-03-07' Python version: 3.11.6 NVIDIA Driver: 546.33

camoody1 commented 6 months ago

It would be outstanding if the moondream model would unload after being used. As it is, now, trying to use this at the start of a workflow takes up 90% of my RAM and makes the rest of the workflow run insanely slow.