Open sean-wade opened 5 years ago
Could you please describe which config you are using?
Could you please describe which config you are using?
I'm using this one: tridentnet_r101v2c4_c5_multiscale_addminival_3x_fp16.py
and it has started training for several hours... Maybe there is something wrong with my datasets?
Which dataset are you using and what about your hardware?
Which dataset are you using and what about your hardware?
It is my own dataset. Voc style.. But I think maybe some annotations has no objects. Will this cause this problem? My hardware is one Tesla P40
That should not be the problem. As the detection_train.py will filter the empty image. https://github.com/TuSimple/simpledet/blob/dd4eb159cf3934b949a89b745f00ddc62c0745c9/detection_train.py#L71
Could you please locate the input that will trigger this problem?
Could you please locate the input that will trigger this problem?
I add print function in the 'worker'. And I got this KeyError... I'm using 2 1080Ti GPU now... Thanks for replying...
I found that when using only 1 GPU, there is no problem... So I can only use 1 GPU now...
@a954217436 i have the same question too,and only use 1 gpu can start the training,i can't find any clue to solve it
I hope some one can reply me ... Thanks a lot!