Open mohamedabdallah1996 opened 6 years ago
Hi,
As I understand for the projects I have done using this repository I use "warmup" initially to let a model adjust to a new dataset. It gets talked about in some other issues. Basic pipeline has 2 steps, first is to run training with warmup for 3-5 epochs initially to let it adjust (you can save those weights), then once it finishes you can use those weights to do standard training. Hope that helps a bit.
please any one can clarify:
thanks