BorealisAI / flora-opt

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
https://arxiv.org/abs/2402.03293
GNU Lesser General Public License v3.0
27 stars 3 forks source link

Clean install of `flora-opt[torch]` fails import #3

Open atong01 opened 1 week ago

atong01 commented 1 week ago
Python 3.10.14 (main, May  6 2024, 19:42:50) [GCC 11.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from flora_opt import Flora
>>> Flora
>>> print(Flora)
None
atong01 commented 1 week ago

This looks like a problem with the pypi package version. Seems to work when installed from source. The pipit package looks like it's missing many files to me.

yongchanghao commented 1 week ago

Thanks for reporting this! I have fixed this issue in commit https://github.com/BorealisAI/flora-opt/commit/c50ee5224df2c9e2f2d75c91a86f3ae2b9d641d6. The PyPI package is also updated to this commit. Please try updating flora-opt from PyPI and see whether it fixes your issue.