Open Bocchi-Chan2023 opened 13 hours ago
First of all, thank you for your excellent work.
I also tried this node, but I get OOM when loading the model. is it possible to add an option to load in 8bit?
Probably, haven't had the time to look into the LLM side of things yet.
First of all, thank you for your excellent work.
I also tried this node, but I get OOM when loading the model. is it possible to add an option to load in 8bit?