lessw2020 Ranger-Deep-Learning-Optimizer issues

lessw2020 / Ranger-Deep-Learning-Optimizer

Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase

Apache License 2.0

1.19k stars 176 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

initial commit of pipelines

#50 nilserl closed 9 months ago
0
added bibtex to cite the optimizer

#49 nestordemeure closed 3 years ago
0
Collate pip package so that it picks up from main repo.

#48 sarthakpati opened 3 years ago
2
ranger and cosine annealing LR leads to different schedule than SGD optimizer? o_O

#47 neuronflow closed 3 years ago
0
Please note in the documentation (or in the constructor) that closures must be enabled

#46 ABotond opened 3 years ago
0
best result : flat learning rate for 75% it means ranger optimizer is not sensitive to lr?

#45 progressforever closed 3 years ago
1
Is adabelief the best optimizer?

#44 LifeIsStrange opened 3 years ago
7
Loss stuck after 1 epoch

#43 jonashaag closed 3 years ago
1
Stochastic Weight Averaging support

#42 Archelunch opened 4 years ago
1
How to use ranger in keras? Please help me.

#41 Kalisa1123 closed 4 years ago
1
This overload of addcmul_ is deprecated: addcmul_(Number value, Tensor tensor1, Tensor tensor2)

#40 neuronflow opened 4 years ago
5
RangerVA with GC

#39 ryancinsight opened 4 years ago
0
The results I tested on the cifar10 dataset are as follows. Ranger's results look strange

#38 zsgj-Xxx opened 4 years ago
1
Does it works well for transformer?

#37 jiang-yuan closed 2 years ago
0
Not able to save the model_state_dict.

#36 shikha10799 closed 4 years ago
1
TypeError in GC operation for Conv layers and FC layers

#35 ZhWL123456 opened 4 years ago
0
What the "GC operations" mean?

#34 ZhWL123456 closed 4 years ago
0
[question] Why Ranger is not available as a pip package

#33 tugot17 opened 4 years ago
3
Gradient centralization was updated

#32 hadaev8 closed 4 years ago
4
Benchmarck Adaptive Scheduling of Stochastic Gradients

#31 LifeIsStrange opened 4 years ago
0
BUG: Fix setstate in RangerVA

#30 scottclowe closed 4 years ago
1
BUG: Module not added to package; not importable

#29 scottclowe closed 4 years ago
8
It makes sense to use it on a batch of 1?

#28 bratao opened 4 years ago
3
Is there a publication of Ranger?

#27 nuzrub closed 4 years ago
2
cannot load trained model using Ranger

#26 ElisonSherton closed 3 years ago
1
Released on PyPI

#25 mpariente closed 4 years ago
1
Add manual synchronization function

#24 qbx2 opened 4 years ago
2
flat+ cosine anneal training curve

#23 shengyuan-tang closed 4 years ago
5
Ranger and pytorch DDP

#22 hadaev8 opened 4 years ago
0
Make Ranger a python package

#21 mpariente closed 4 years ago
2
Making it a python package

#20 mpariente closed 4 years ago
4
Loading state doesn't seem to be fully working

#19 tchaton opened 4 years ago
0
larger learning rate + large weight decay performs better?

#18 askerlee opened 4 years ago
0
Could someone tell me how to use it?

#17 gxwangupc closed 4 years ago
2
How to cite Ranger in a paper?

#16 askerlee closed 4 years ago
6
Too huge step_size at initialization stage

#15 e-sha opened 5 years ago
1
Grad norm and ranger

#14 hadaev8 closed 4 years ago
0
Did you try to fine-tune transformers LM with Ranger?

#13 avostryakov opened 5 years ago
4
Do we need some kind of Learning rate decay with Ranger?

#12 avostryakov closed 5 years ago
3
AttributeError: 'Ranger' object has no attribute 'radam_buffer'

#11 kayuksel closed 5 years ago
4
Spelling, variables and PEP8

#10 pablogps opened 5 years ago
6
Fix bug in RAdams buffering code

#9 sholderbach closed 5 years ago
1
step_counter not set

#8 m-toman closed 5 years ago
5
N_sma_threshhold should be instance variable

#7 ohmorimori closed 5 years ago
2
N_sma_threshhold

#6 kayuksel closed 5 years ago
2
Let's revolutionize the AI research field

#5 LifeIsStrange closed 5 years ago
2
Dose any one has tested this composed Optimizer?

#4 heartInsert closed 5 years ago
7
Keras implementation

#3 jetjodh closed 6 months ago
1
Variance tractability fix

#2 fparodimoraes closed 5 years ago
3
Not working using cuda

#1 Fable67 closed 5 years ago
2