Open fenaux opened 2 years ago
After a random number of iterations I get NaN or Inf found in input tensor
I made some tests and insert a test in "train_one_iteraton", when this occurs there NaN at the output of get_augmented_gt_seq_for_training
I also checked there are no NaN values in data
I'm seeing this issue too - has anyone figured out what's going on? @papagina any ideas? I'd love to reproduce these results for a project/paper I'm working on!
After a random number of iterations I get NaN or Inf found in input tensor
I made some tests and insert a test in "train_one_iteraton", when this occurs there NaN at the output of get_augmented_gt_seq_for_training
I also checked there are no NaN values in data