search

AIFSH / OmniGen-ComfyUI

MIT License
160 stars 19 forks source link

Keep Model in VRAM #7

Open 0X-JonMichaelGalindo opened 2 weeks ago

0X-JonMichaelGalindo commented 2 weeks ago

Attach the OmniGen pipeline to the node instance as an attribute to avoid unloading the model from VRAM after each generation completes. Is this the right way to do this? It works in my local Comfy test, but I am not sure.

AIFSH commented 2 weeks ago

low Varm unfriendly

saftle commented 2 weeks ago

High vram friendly. I suggest maybe making it as an option perhaps?

saftle commented 2 weeks ago

I went ahead and added my changes to an existing PR I created, otherwise the PR would have probably failed https://github.com/AIFSH/OmniGen-ComfyUI/pull/13. Thanks for the inspiration @0X-JonMichaelGalindo