Models that are NPMI-optimized are archived one epoch too late

allenai / vampire

Variational Methods for Pretraining in Resource-limited Environments

Apache License 2.0

174 stars 33 forks source link

Models that are NPMI-optimized are archived one epoch too late #31

Closed dangitstam closed 5 years ago

dangitstam commented 5 years ago

NPMI for the current model state is computed at the end of NLL validation. This is makes it so that at any point in time, a model's NPMI score is actually that of the model state from the end of the previous epoch.

kernelmachine commented 5 years ago

Addressed by #35 , closing.