doucment completion evaluation results in a nan

adjidieng / ETM

Topic Modeling in Embedding Spaces

MIT License

538 stars 126 forks source link

doucment completion evaluation results in a nan #9

Closed khaledJabr closed 4 years ago

khaledJabr commented 4 years ago

Hello,

Thank you for your work. I am running into an issue with the code when trying it with different datasets. With some datasets, the document completion evaluation during training produces a nan when using the evaluation docs, and I am not sure understand what that means. Does that mean that the model is not as good in predicting the second half? or is it something wrong with the learning process?

irazakharchenko commented 3 years ago

Hi,

I got the same error. Can you give some information on how did you solve your problem?

I found that the method get_theta from ETM class returns an empty tensor.

irazakharchenko commented 3 years ago

I fixed the issue, I had. The problem was bad tokens_1 declaration in _fetch data.py. Hope it will help.