Open NeuroLord opened 4 months ago
Trying to execute the code on my RTX 3060 and unfortunately I get an error of insufficient memory (OOM). Is it possible to optimize the generation so that everything works as it should? Or maybe it is possible to run on CPU?
Trying to execute the code on my RTX 3060 and unfortunately I get an error of insufficient memory (OOM). Is it possible to optimize the generation so that everything works as it should? Or maybe it is possible to run on CPU?