kijai / ComfyUI-HunyuanVideoWrapper

182 stars 5 forks source link

[Request] Load LLM and clip in 8bit #11

Open Bocchi-Chan2023 opened 13 hours ago

Bocchi-Chan2023 commented 13 hours ago

First of all, thank you for your excellent work.

I also tried this node, but I get OOM when loading the model. is it possible to add an option to load in 8bit?

kijai commented 10 hours ago

Probably, haven't had the time to look into the LLM side of things yet.