search

shoaibahmed / blockwise_ssl

Repository containing code for blockwise SSL training
27 stars 4 forks source link

About the running time #2

Closed Big-Brother-Pikachu closed 2 months ago

Big-Brother-Pikachu commented 2 months ago

Hi, thanks for sharing this wonderful work. We have tried to run your codes on our 2 A800 GPUs, but have found that we need 1300~ hours to finish the 300 epochs ImageNet experiment. Is it normal? Or could you tell us approximately how long it takes for you to conduct an experiment? This will be of great help to us. Thank you!

shoaibahmed commented 2 months ago

Hi, Thanks for your interest. Some of the models we trained took about a week on 32 A6000s. We chose such a long training schedule to match the training scheme used in prior work such as Barlow Twins.

Big-Brother-Pikachu commented 2 months ago

OK, I get it! Thanks for your reply!