search

amansrivastava17 / embedding-as-service

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques
MIT License
204 stars 29 forks source link

fix(xlnet): Set training mode to False and set dropout to zero #47

Closed chiragjn closed 2 years ago

chiragjn commented 4 years ago

Attempts to fix #45

Taken directly from https://github.com/zihangdai/xlnet/pull/151/commits/d1d0ff4d0d2e536e897adabcdd04683e62dfa7a4

Todo:

amansrivastava17 commented 4 years ago

@chiragjn LGTM, should we merge this?

chiragjn commented 4 years ago

unfortunately, this still does not solve the problem, without going component by component it is hard to tell what is still causing the variance :(

chiragjn commented 2 years ago

Closing this for now, this still remains a issue :upside_down_face: