search

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
8.89k stars 490 forks source link

Donating System Memory? #586

Open NavodPeiris opened 1 week ago

NavodPeiris commented 1 week ago

is there a way to donate System memory instead of GPU VRAM?

this may become more economical