search

LikeLy-Journey / SegmenTron

Support PointRend, Fast_SCNN, HRNet, Deeplabv3_plus(xception, resnet, mobilenet), ContextNet, FPENet, DABNet, EdaNet, ENet, Espnetv2, RefineNet, UNet, DANet, HRNet, DFANet, HardNet, LedNet, OCNet, EncNet, DuNet, CGNet, CCNet, BiSeNet, PSPNet, ICNet, FCN, deeplab)
Apache License 2.0
705 stars 162 forks source link

the problem occurred during training #63

Open XJLXuJiaLi opened 4 years ago

XJLXuJiaLi commented 4 years ago

Traceback (most recent call last): File "tools/train.py", line 272, in trainer.train() File "tools/train.py", line 163, in train losses.backward() File "/home/xjl/.conda/envs/env_torch/lib/python3.6/site-packages/torch/tensor.py", line 107, in backward torch.autograd.backward(self, gradient, retain_graph, create_graph) File "/home/xjl/.conda/envs/env_torch/lib/python3.6/site-packages/torch/autograd/init.py", line 93, in backward allow_unreachable=True) # allow_unreachable flag RuntimeError: cuda runtime error (11) : invalid argument at /pytorch/aten/src/THC/THCGeneral.cpp:383

the problem occurred during training.how to slove it?thank you