round batch size usign floor() and change order of start and end lr

mlverse / luz

Higher Level API for torch

https://mlverse.github.io/luz/

Other

84 stars 12 forks source link

round batch size usign floor() and change order of start and end lr #60

Closed cmcmaster1 closed 3 years ago

cmcmaster1 commented 3 years ago

floor() fixes a problem with dataset length not being divisible by the number of steps (resulted in batch size = dataset length and lots of CUDA memory issues for me!)

I accidentally made my original PR using annealing from high LR to low LR. It should be the other way around. Now fixed.

dfalbel commented 3 years ago

Thanks @cmcmaster1 !