search

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
9.27k stars 524 forks source link

Fix beam search in GPU clients #531

Closed borzunov closed 1 year ago

borzunov commented 1 year ago

Fixes #503.