search

AnswerDotAI / fsdp_qlora

Training LLMs with QLoRA + FSDP
Apache License 2.0
1.42k stars 188 forks source link

[`Docs`] Update bnb installation guidelines for users that want to install bnb from source #18

Closed younesbelkada closed 8 months ago

younesbelkada commented 8 months ago

Hi!

Thanks for this great work! I noticed that in the readme you mention to use make commands to install bnb from source. Note the Makefile has been removed in favor of CMake and the Makefile cannot be found here: https://github.com/AnswerDotAI/bitsandbytes As the commits to add FSDP support has been upstreamed into bnb main, I propose to reflect the readme to the official installation guidelines that properly guides users on how to install bnb from source

cc @jph00

warner-benjamin commented 8 months ago

@younesbelkada I updated the ReadMe in 6b7cdb5, which includes updated bitsandbytes installation instructions. Once bitsandbytes 0.43 is released we'll remove the custom installation instructions and only have the pip install.

younesbelkada commented 8 months ago

Thanks @warner-benjamin the release should be live in the next couple of minutes

cc @Titus-Von-Koeller

younesbelkada commented 8 months ago

@warner-benjamin bnb 0.43.0 is now live: https://pypi.org/project/bitsandbytes/

warner-benjamin commented 8 months ago

Resolved with 47c1722