Open KyriaAnnwyn opened 2 years ago
If I set "devices": "cuda:1" in config json, the model is still loaded to device 0 and the error that tensors are on different devices in calculations occurs.
feel free to open a PR with a fix if you want?
If I set "devices": "cuda:1" in config json, the model is still loaded to device 0 and the error that tensors are on different devices in calculations occurs.