Open copybara-service[bot] opened 3 months ago
Fix init_value and end_value in cosine decay
Problem:
Solution:
init_value
end_value
Misc: renamed alpha -> end_value in warmup_cosine_decay_schedule
Fix init_value and end_value in cosine decay
Problem:
Solution:
init_value
andend_value
respectivelyMisc: renamed alpha -> end_value in warmup_cosine_decay_schedule