search

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
8.89k stars 489 forks source link

Fix beam search in GPU clients #531

Closed borzunov closed 8 months ago

borzunov commented 8 months ago

Fixes #503.