NTMC-Community / MatchZoo

Facilitating the design, comparison and sharing of deep text matching models.
Apache License 2.0
3.82k stars 898 forks source link

DRMM Model Gives Different Results #816

Closed hvarolerdem closed 4 years ago

hvarolerdem commented 4 years ago

DRMM Model Gives Different Results with the same Input

I am using the DRMM model. As in the tutorial i saved the desired model. However, when i load the and use the corresponding model, it gives different scores every time with the same input. Is there any solution about this issue, or if i am wrong, what can i do? In summary,

1) I convert my data as in the tutorial. 2) I set up model parameters and select ranking scores. 3) I train the model and save it in each epoch.
4) Then, i upload the model, transform test data for input and getting results. 5) I repeat the same process but getting different results with the same data.

Thanks in advance

hvarolerdem commented 4 years ago

I solved the issue by saving the preprocessor object. When we load it, we can obtain same results.