I just ran train.py on the LJS dataset, and I got this error:
Exception has occurred: ProcessRaisedException
-- Process 0 terminated with the following error:
Traceback (most recent call last):
File "/home/steven.hoang/.conda/envs/meta/lib/python3.10/site-packages/torch/multiprocessing/spawn.py", line 69, in _wrap
fn(i, *args)
File "/home/steven.hoang/vits/train.py", line 117, in run
train_and_evaluate(rank, epoch, hps, [net_g, net_d], [optim_g, optim_d], [scheduler_g, scheduler_d], scaler, [train_loader, eval_loader], logger, [writer, writer_eval])
File "/home/steven.hoang/vits/train.py", line 190, in train_and_evaluate
scaler.scale(loss_gen_all).backward()
File "/home/steven.hoang/.conda/envs/meta/lib/python3.10/site-packages/torch/_tensor.py", line 363, in backward
torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs)
File "/home/steven.hoang/.conda/envs/meta/lib/python3.10/site-packages/torch/autograd/init.py", line 173, in backward
Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass
RuntimeError: view_as_complex is only supported for float and double tensors, but got a tensor of scalar type: Half
File "/home/steven.hoang/vits/train.py", line 50, in main
mp.spawn(run, nprocs=n_gpus, args=(n_gpus, hps,))
File "/home/steven.hoang/vits/train.py", line 290, in
main()
I just ran train.py on the LJS dataset, and I got this error:
Exception has occurred: ProcessRaisedException
-- Process 0 terminated with the following error: Traceback (most recent call last): File "/home/steven.hoang/.conda/envs/meta/lib/python3.10/site-packages/torch/multiprocessing/spawn.py", line 69, in _wrap fn(i, *args) File "/home/steven.hoang/vits/train.py", line 117, in run train_and_evaluate(rank, epoch, hps, [net_g, net_d], [optim_g, optim_d], [scheduler_g, scheduler_d], scaler, [train_loader, eval_loader], logger, [writer, writer_eval]) File "/home/steven.hoang/vits/train.py", line 190, in train_and_evaluate scaler.scale(loss_gen_all).backward() File "/home/steven.hoang/.conda/envs/meta/lib/python3.10/site-packages/torch/_tensor.py", line 363, in backward torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs) File "/home/steven.hoang/.conda/envs/meta/lib/python3.10/site-packages/torch/autograd/init.py", line 173, in backward Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass RuntimeError: view_as_complex is only supported for float and double tensors, but got a tensor of scalar type: Half File "/home/steven.hoang/vits/train.py", line 50, in main mp.spawn(run, nprocs=n_gpus, args=(n_gpus, hps,)) File "/home/steven.hoang/vits/train.py", line 290, in
main()