search

NVIDIA / ContrastiveLosses4VRD

Implementation for the CVPR2019 paper "Graphical Contrastive Losses for Scene Graph Generation"
Other
199 stars 41 forks source link

Warning: NaN or Inf found in input tensor. #14

Open liangxuy opened 4 years ago

liangxuy commented 4 years ago

Thanks for the code. However, whenever I run the training on VRD dataset with the default setting, I met the 'Warning: NaN or Inf found in input tensor' problem. I wonder if anyone else met similar problem? image

coldmanck commented 4 years ago

Hi @liangxuy and @jz462

I also encountered this problem during training on pytorch-1.0 branch. I am wondering whether it matters or not, as most of the training losses (as showed in screenshot above, loss_cls_ttl, loss_contrastive_sbj, loss_contrastive_obj, loss_so_contrastive_sbj, etc.) become nan.