search

dvlab-research / Parametric-Contrastive-Learning

Parametric Contrastive Learning (ICCV2021) & GPaCo (TPAMI 2023)
https://arxiv.org/abs/2107.12028
MIT License
241 stars 32 forks source link

Why the learning rate in the provided checkpoint is 0.00000065 #25

Closed FouriYe closed 4 months ago

FouriYe commented 4 months ago

I want to fine tune the good work in ImageNet-LT. However, when I reloaded the provided checkpoint (ResNet50), I found the learning rate is 0.00000065. But if I retrain from epoch 0, the learning rate should be 0.00395612 at epoch 400, according to the provided scripts (./sh/LT/ImageNetLT_train_R50.sh).

Why is it the such value? Thanks!