Open wenchangzhou-qtx opened 6 months ago
Ditto here, I get some weird issues on CPU. The pre-trained models worked well for me, but I had to manually override a variety of "device" settings to force PyTorch not to try and use a non-existent CUDA device.
I'm guessing there's some settings being cached in the pre-trained models that aren't updated when they're loaded in generate.py
?
Hey, is it possible to run cpu mode? I saw it's possible from the
generate.py
, but when I tried I got this error: