issues
search
SmerkyG
/
gptcore
Fast modular code to create and train cutting edge LLMs
Apache License 2.0
62
stars
9
forks
source link
Schedulefree
#10
Open
hypnopump
opened
5 months ago
hypnopump
commented
5 months ago
Adds ScheduleFree optimizer.
Tested on a small model (60M) and works well
Nit: v7 correct name for logging