I confirm Petals not working in Google Colab

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

https://petals.dev

MIT License

9.11k stars 512 forks source link

Open AIAnytime opened 11 months ago

AIAnytime commented 11 months ago

Tuple index out of range. Something is broken.

justheuristic commented 11 months ago

Working on it, thanks for reporting the problem

justheuristic commented 11 months ago

Colab example now works with the hotfix suggested in #536

I'm currently figuring out the best way to patch petals for compatibility with latest transformers. Will keep you posted