kozistr pytorch_optimizer issues

kozistr / pytorch_optimizer

optimizer & lr scheduler & loss function collections in PyTorch

https://pytorch-optimizers.readthedocs.io/en/latest/

Apache License 2.0

242 stars 21 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[Release] v3.3.0

#298 kozistr closed 1 day ago
1
[Docs] document stuff

#297 kozistr closed 2 days ago
1
ADOPT has an important stability update

#296 ogencoglu closed 2 days ago
3
[Fix] Add optimizer parameter to PolyScheduler constructor.

#295 tanganke closed 3 days ago
1
[Feature] Cautious optimizer, improve the stability of ADOPT optimizer, a new projector type `random` for `GaLore` optimizer

#294 kozistr closed 3 days ago
1
Cannit run with adam_mini

#293 atonyo11 closed 3 days ago
3
[Refactor] Remove direct import of many methods from `utils`, etc

#292 kozistr closed 1 week ago
1
[Feature] Implement FTRL optimizer

#291 kozistr closed 1 week ago
1
[Feature] Implement ADOPT optimizer

#290 kozistr closed 3 weeks ago
1
Support Adopt

#289 sdbds closed 3 weeks ago
0
[Feature] Support `palm` variant for `ScheduleFreeAdamW` optimizer

#288 kozistr closed 3 weeks ago
1
Add torch._foreach_ for speed up

#287 sdbds opened 3 weeks ago
0
schedulefree with palm schedule

#286 sdbds closed 3 weeks ago
0
[Release] v3.2.0

#285 kozistr closed 1 month ago
1
[Feature] Implement CPUOffloadOptimizer

#284 kozistr closed 1 month ago
1
[Fix] when `model_or_parameter` is not `nn.Module` instance.

#283 kozistr closed 1 month ago
1
[Fix] Implement better `wd_ban_list` handling

#282 Vectorrent closed 1 month ago
2
[Feature] Support 8/4bit, fp8 optimizers

#281 kozistr closed 1 month ago
1
[Fix] `should_grokfast` condition

#280 kozistr closed 1 month ago
1
'grokfast_after_step' argument causes the optimizer to crash

#279 Vectorrent closed 1 month ago
1
SophiaH implementation is not correct

#278 Vectorrent closed 1 month ago
4
[CI] to Python 3.12

#277 kozistr closed 2 months ago
1
[Deps] Update `bitsandbytes` to 0.44.0

#276 kozistr closed 2 months ago
1
[Feature] Implement SOAP optimizer

#275 kozistr closed 2 months ago
1
Support SOAP

#274 sdbds closed 2 months ago
0
Support SaRA

#273 sdbds opened 2 months ago
0
[Feature] Implement AdEMAMix optimizer

#272 kozistr closed 2 months ago
1
[Fix] Add missing kwargs

#271 kozistr closed 3 months ago
1
The `create_optimizer()` function fails when Lookahead arguments are provided

#270 Vectorrent closed 3 months ago
1
[Release] v3.1.1

#269 kozistr closed 3 months ago
1
[Update] Coverage

#268 kozistr closed 3 months ago
1
[Fix] device mismatch problems

#267 kozistr closed 3 months ago
1
Prodigy optimizer cannot be resumed from checkpoint

#266 Vectorrent closed 3 months ago
4
[Feature] Implement AdamG optimizer

#265 kozistr closed 3 months ago
1
AdamG: Towards Stability of Parameter-free Optimization

#264 Vectorrent closed 3 months ago
6
[Feature] Implement TRAC optimizer

#263 kozistr closed 3 months ago
1
Add WeLore

#262 rotem154154 closed 2 months ago
2
[Refactor] code

#261 kozistr closed 4 months ago
1
[Update] Improve the performance

#260 kozistr closed 4 months ago
1
[Refactor] Stuffs

#259 kozistr closed 4 months ago
1
[Feature] Implement `AdaLOMO` optimizer and others

#258 kozistr closed 4 months ago
1
[BUG Fix]Fix 3 bugs for Adam-Mini

#257 sdbds closed 4 months ago
1
Add TRAC

#256 sdbds closed 3 months ago
0
[Feature] Add visualizations

#255 kozistr closed 4 months ago
1
[Update] v3.0.2

#254 kozistr closed 4 months ago
1
[Feature] Implement AdamMini optimizer

#253 kozistr closed 4 months ago
1
[Feature] Implement StableAdamW optimizer

#252 kozistr closed 4 months ago
1
[Feature] Implement Kate optimizer

#251 kozistr closed 4 months ago
1
Add StableAdamW

#250 tfriedel closed 4 months ago
0
Add Kate

#249 tfriedel closed 4 months ago
6