bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
8.89k stars 490 forks source link

install script to help the project deployment or for easy use #544

Open elsolo5000-2 opened 7 months ago

elsolo5000-2 commented 7 months ago

install script to help the project deployment or for easy use. actually he is alone for windows wsl nvidia config. but feel free to put it in a folder with other type of install scripts and call it from elsewhere.. idk.. like src/utils/install_scripts/ also i hardcoded stable beluga 2 inside, i do not know how to propose different disponibles models. and i commented out the end lines to run the server but feel free to change.

in short feel free to improove or i perhaps will

PS. i hate vim PS2.i m new to git