issues
search
facebookresearch
/
schedule_free
Schedule-Free Optimization in PyTorch
Apache License 2.0
1.54k
stars
49
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
How do I retrive current LR from the optimizer now?
#33
pkpro
closed
3 days ago
1
When saving/loading optimizer using state_dict(), a mismatch between state["z"] and param (self.state[p]) will occur.
#32
poutyface
closed
1 week ago
4
Guidelines for Learning Rates
#31
MarkWijkhuizen
opened
2 weeks ago
1
Doesnot work with torch.compile
#30
yuanzhi-zhu
opened
3 weeks ago
1
Reference AdamW?
#29
muslll
closed
3 weeks ago
1
Foreach detection
#28
adefazio
closed
1 month ago
0
Regular AdamW scores just as well on MNIST? + Feature request...
#27
drscotthawley
closed
1 month ago
2
AttributeError: module 'torch' has no attribute '_foreach_lerp_'
#26
patriksimurka
closed
1 month ago
1
Paper release
#25
adefazio
closed
1 month ago
0
Compatibility with MuP (Maximal Update Parametrization)
#24
simonguozirui
opened
1 month ago
0
Typo in paper?
#23
ad8e
closed
1 month ago
3
Weights before saving are different from loaded weights while training with AdamWScheduleFree
#22
talrub
closed
1 month ago
4
Can this be tested in kohya_ss
#21
rafstahelin
closed
3 weeks ago
3
Fixing typos here and there
#20
konstmish
closed
2 months ago
2
Foreach fix
#19
adefazio
closed
2 months ago
0
bug going from 1.2.1 to 1.2.2
#18
MarcoForte
closed
2 months ago
2
Fix typo in SGDScheduleFree docstring
#17
boisgera
closed
2 months ago
2
Retrieve LR
#16
bhack
closed
2 months ago
1
Does saved parameters need adjusted?
#15
FykAikawa
closed
2 months ago
4
ERROR: Could not build wheels for schedulefree
#14
talrub
opened
2 months ago
1
Delete schedulefree/__pycache__ directory
#13
bryant1410
closed
2 months ago
1
Non-closure Prodigy?
#12
madman404
opened
2 months ago
2
batchnorm and intermittent evals
#11
sniklaus
closed
2 months ago
4
Add foreach to optimizers
#10
drhead
closed
2 months ago
5
Minimal harness for running CIFAR10 experiments
#9
nelaturuharsha
opened
2 months ago
4
Usage with Torch's Autocast and GradScaler
#8
fhahlbohm
closed
1 month ago
6
Update README.md
#7
eltociear
closed
2 months ago
1
Tracking effective learning rate
#6
drhead
closed
2 months ago
2
[BUG]ZeroDivisionError: float division by zero
#5
sdbds
closed
2 months ago
6
fix small typo, .val() -> .eval()
#4
mrdbourke
closed
2 months ago
3
DeepSpeed support?
#3
catid
closed
2 months ago
1
nit: grammar
#2
BasedLukas
closed
2 months ago
1
Add `examples` folder, `mnist` example
#1
tfaod
closed
2 months ago
0