search

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
9.27k stars 524 forks source link

Repeated missingblockserror #328

Open hazelsilver8740 opened 1 year ago

hazelsilver8740 commented 1 year ago

Hello! I'm currently running bloomz-petals on a Google Colab notebook in order to make use of the free GPU. However, I've recently started receiving the following error:

MissingBlocksError: No servers holding blocks 0 are online. You can check the public swarm's state at http://health.petals.ml/ If there are not enough servers, please connect your GPU: https://github.com/bigscience-workshop/petals#connect-your-gpu-and-increase-petals-capacity

The public swarm's state seems okay and I can sometimes get everything to work (it's a dice roll). If anyone could please explain this error and give ideas to solve it, that would be extremely helpful! Thank you!

coolrazor007 commented 1 year ago

I'm having this issue too. Even with a copy-paste of the code example from this GitHub.