This PR implements PyTorch's lr_find() feature in our code, basically a nifty grid search function just designed for the lr.
What should I expect to see?
The PR has the imlementation in train_model.py and also includes an assert statement to block it from happening in tandem with grid search (which doesn't make sense) and a way to invoke it detailed in the new template config.
I also standardized some of the type hinting in the template yaml changing the mix of (str) and (string) all to the former.
Appendix
Q: How many fords or fjords could a Ford ford if a Ford could ford fords and fjords?
A: As many fords and fjords as a Ford could ford if a Ford could ford fords and fjords!
What's the deal?
This PR implements PyTorch's lr_find() feature in our code, basically a nifty grid search function just designed for the lr.
What should I expect to see?
The PR has the imlementation in train_model.py and also includes an assert statement to block it from happening in tandem with grid search (which doesn't make sense) and a way to invoke it detailed in the new template config. I also standardized some of the type hinting in the template yaml changing the mix of
(str)and(string)all to the former.Appendix
Q: How many fords or fjords could a Ford ford if a Ford could ford fords and fjords? A: As many fords and fjords as a Ford could ford if a Ford could ford fords and fjords!