issues
search
DRAGNLabs
/
301r_retnet
2
stars
1
forks
source link
Add perplexity metric
#46
Closed
JayOrten
closed
3 months ago
JayOrten
commented
3 months ago
Remove the parameter 'value_embed_dim', and related assertion; it isn't being used anywhere in the code, seems vestigial from past refactoring.
Add perplexity logging in validation step of model training.
Add a parameter to the config file for precision, as well as passes that parameter to lightning during training, to use lower bit precision.