Add OpenAI compatible API

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

https://petals.dev

MIT License

8.89k stars 489 forks source link

Closed RomaA2000 closed 7 months ago