search

tryolabs / luminoth

Deep Learning toolkit for Computer Vision.
https://tryolabs.com
BSD 3-Clause "New" or "Revised" License
2.41k stars 399 forks source link

nan train loss while training SSD #277

Open sbhavani opened 5 years ago

sbhavani commented 5 years ago

Getting train_loss: nan at every step running training for SSD. I tried varying batch_size and learning_rate but still no improvement.

InvalidArgumentError (see above for traceback): Nan in summary histogram for: ssd/ssd_feature_extractor/conv_4_3_norm/conv4_3_normalized_hist

afaq-ahmad commented 5 years ago

same problem