issues
search
kyegomez
/
Sophia
Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
https://discord.gg/qUtxnK2NMf
Apache License 2.0
377
stars
26
forks
source link
Can i use Sophia with qlora ?
#22
Open
eleluong
opened
1 year ago
eleluong
commented
1 year ago
Upvote & Fund
We're using
Polar.sh
so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.
kyegomez
commented
1 year ago
@eleluong Hey maybe!
kyegomez
commented
1 year ago kyegomez
commented
1 year ago
Upvote & Fund