search

OpenLMLab / LOMO

LOMO: LOw-Memory Optimization
MIT License
978 stars 68 forks source link

cannot find adalomo class #60

Closed Yeojoon closed 1 year ago

Yeojoon commented 1 year ago

In adalomo/instruction-tuning/train.py, AdaLomo is imported from collie.optim but I cannot such optimizer from collie.optim. Would it be possible to help me with finding the implementation of AdaLomo? Thanks!

KaiLv69 commented 1 year ago

Hi, AdaLomo now is implemented in the dev branch of collie. It may take some time to merge into the main branch. You can install the dev branch and have a try :)

Yeojoon commented 1 year ago

oh I see. Thank you for your kind reply!