What's the benefit of warmup?

YuwenXiong / py-R-FCN

R-FCN with joint training and python support

MIT License

1.05k stars 471 forks source link

What's the benefit of warmup? #15

Closed CPFLAME closed 8 years ago

CPFLAME commented 8 years ago

It's so nice of you to share the code with us,it's a wonderful work! I know about ohem which is to select hard examples and re-train them,but what's the use of warmup? waiting for your apply!

YuwenXiong commented 8 years ago

That is one of my attempts to solving the problem that joint training with OHEM will deliver slightly lower mAP by using a smaller learning rate at the beginning. But I failed, so please just ignore it.