Hello project owners,
I have been facing an issue that when the models is being trained on the Ubuntu V2 dataset it calculates loss=nan right from the very beginning and even after 2000 steps does not change. I have not changed the code at all except that I upgraded it to support latest python and tensorflow v2. I checked every possible scenario that can lead to nan values but it still wont calculate loss.
Hello project owners, I have been facing an issue that when the models is being trained on the Ubuntu V2 dataset it calculates loss=nan right from the very beginning and even after 2000 steps does not change. I have not changed the code at all except that I upgraded it to support latest python and tensorflow v2. I checked every possible scenario that can lead to nan values but it still wont calculate loss.
Any clues ? Really appreciate your response.