search

artetxem / undreamt

Unsupervised Neural Machine Translation
GNU General Public License v3.0
474 stars 77 forks source link

"nan" error occurs for the valuable "logprobs" in L87 of translator.py #8

Open JunjieHu opened 6 years ago

JunjieHu commented 6 years ago

Hi, I am running an experiment for unsupervised Slovak-English translation. I get the "nan" error during beam search decoding. That is, the valuable "logprobs" in L87 of translator.py contains all "nan". https://github.com/artetxem/undreamt/blob/master/undreamt/ translator.py#L87

I follow the same setting in your paper (train bilingual wordings by vecmap and run for 300k iterations). Does anyone know how to fix it? Thanks!

artetxem commented 6 years ago

It looks like the error is on greedy decoding, not beam search. Does this happen at training or test time?

JunjieHu commented 6 years ago

Hi sorry for the late response. I know the error happens during the test time. But I didn't print out the logprobs during the training, I am not sure whether this value becomes "nan" or not during training time (but I guess it happens).

masonreznov commented 4 years ago

Hello @JunjieHu, did you solve the NAN problem?

JunjieHu commented 4 years ago

Hi @masonreznov unfortunately I didn't solve the NAN problem. Maybe @artetxem could suggest a fix to this.

mlschomaker commented 3 years ago

I have the same issue, this happens during training as well for me