search

facebookresearch / d2go

D2Go is a toolkit for efficient deep learning
Apache License 2.0
837 stars 200 forks source link

Enable training for fraction of total steps; enable early stopping from trial 0 #627

Closed ifed-ucsd closed 11 months ago

ifed-ucsd commented 11 months ago

Summary: Enable training for fraction of total steps: when doing HPO, users may want to train for a fraction of the number of training steps of a regular (baseline) training run. In this case, it is not enough to just change SOLVER.MAX_ITER because that also changes the learning rate schedule. We introduce a multiplier to be used on top of SOLVER.MAX_ITER when deciding how many steps to train for. This multiplier does not scale the number of steps over which the learning rate schedule is defined.

Reviewed By: raghuramank100

Differential Revision: D48699087

facebook-github-bot commented 11 months ago

This pull request was exported from Phabricator. Differential Revision: D48699087

facebook-github-bot commented 11 months ago

This pull request was exported from Phabricator. Differential Revision: D48699087

facebook-github-bot commented 11 months ago

This pull request has been merged in facebookresearch/d2go@3c7244165a888421ef60004fea8044d0166892ac.