lessw2020 / Ranger21

Ranger deep learning optimizer rewrite to use newest components
Apache License 2.0
321 stars 45 forks source link

hi,please help me #46

Closed wudizuixiaosa closed 2 years ago

wudizuixiaosa commented 2 years ago

Hi, first of all, praise your work, because I'm a beginner, so I want to ask you how to use your Ranger optimizer. Because I see a lot of parameters in your code settings. I am currently using

optimizer = Ranger21(model.parameters(), lr = 3e-5, num epochs = 90, num batches per epoch = 16)

However, assertionerror: LR wentnegative is displayed