[Test PR] set position, run CI

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

https://petals.dev

MIT License

9.26k stars 524 forks source link

[Test PR] set position, run CI #595

Closed justheuristic closed 4 months ago

justheuristic commented 4 months ago

This pull request is not to be merged; it is used in a discussion with @xtinkt to compare two implementations for speculative decoding. It will be closed in a few days.