hustvl / YOLOS

[NeurIPS 2021] You Only Look at One Sequence
https://arxiv.org/abs/2106.00666
MIT License
827 stars 118 forks source link

About learning rate scheduler #9

Closed davidnvq closed 2 years ago

davidnvq commented 2 years ago

❔Question

From your code main.py, I only see the learning rate updated after every epoch: https://github.com/hustvl/YOLOS/blob/2e10dc45b5effc015bd64d597b546caf47fb3c0e/main.py#L217

Looking at your logs, it also seems to confirm that. Did you use a warm-up learning rate scheduler for the first few iterations?

Yuxin-CV commented 2 years ago

Hello, thanks for your interest in our work.

We don't use warm up during training.

davidnvq commented 2 years ago

Thanks for swift reply. I'll close.