Closed bittremieux closed 7 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Comparison is base (
83a1ce4
) 89.64% compared to head (0c0ccaa
) 89.77%.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Ideally we fix it in the code as well. Otherwise other people who try fine-tuning will have the same problem.
I added a unit test to check this and added a fix to remove unrecognized hyperparameters during model loading. This seems to work, but I find it a bit less elegant than the previous fix, because now we're changing config options both in Config
and in Spec2Pep
. Do you see any alternative solutions @melihyilmaz @wfondrie?
Fixes #242.
cosine_schedule_period_iters
better reflects what this config option does, and has correspondingly been renamed.The config loader checks whether
max_iters
is specified and automatically remaps it tocosine_schedule_period_iters
, while warning the user about this renaming.