Closed alohays closed 3 years ago
Hi, it is implemented as a hook. I have uploaded it to this repo. Please refer to hooks/densecl_warmup_hook.py for details.
For usage, you just need to add this to your config file:
custom_hooks = [ dict(type='DenseCLWarmupHook', start_iters=10000) ]
Thank you for your great work. Could you give the implementation detail or code of the loss_lambda warmup setting stated in the DenseCL paper?