Open shouyinz opened 5 years ago
I need to check what cause this NaN issue, and will reply you later
And any constraint for the training dataset
to train our own model ?
e.x. the target mask area must be larger than certain proportion to the label image?
I also meet this problem .I use dataset MSRA10K to train the model , but the loss become NAN at the third
epoch. Have you solved this problem?
Hi,
I'm trying to train my own model according to your implementation. Since I encounter some gradient error cause Nan or Inf error.
Below is the log when training crash
Could you help to comment about it. I also wonder the tensorflow version or more detail for training environment of pre-build model.
Thanks.