Wait for DHT storing state OFFLINE on shutdown

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

https://petals.dev

MIT License

9.11k stars 512 forks source link

Closed borzunov closed 1 year ago

borzunov commented 1 year ago

This won't help if you hold Ctrl+C, but may help if you press it 1-3 times and wait for the server to finish gracefully.