Add loading LoRA adapters from clients' requests

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

https://petals.dev

MIT License

8.89k stars 489 forks source link

Open artek0chumak opened 10 months ago