Closed Anyway2022 closed 2 years ago
Do you try to install torchlars as the last one?
Other libraries are installed without problems. Only Torchlars cannot be installed. So, Am I supposed to install Torchlars as the first one? or the last one?
Almost same error here:https://github.com/kakaobrain/torchlars/issues/10
You should install Torchlars as the last one.
Unfortunately, I tried but failed at last. Now that Lars facilitates a large batch size, Is it appropriate that I use sgd instead?
LARS is implemented as a wrapper around SGD, so you could try removing it and use directly SGD. We never tried training HyMOS without LARS, in principle it should work, even if we cannot guarantee that it would obtain the exact same results
Thank you~ Actually, I tried to use SGD directly but failed to reproduce the results. But the good news is that I succeeded in installing torchlars lib on another server with different OS and GPUs. Now, I can reproduce these results in the paper. Fantastic research work!
Does anyone have the same problem?