search

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
8.89k stars 489 forks source link

Incentive system based on Lightning #494

Open earonesty opened 10 months ago

earonesty commented 10 months ago

i feel like this solution should just be merged to main, so petals grows 👍

https://github.com/kouloumos/petals-lightning-chat

with a simple incentive system, there could be a lot more capacity.

would you be open to adding a lnurl support to petals at a lower layer?

i'm thinking some simple optional configuration for people who donate and use gpus that turn on lightning micropayments, should be fairly trivial to set maximums, etc.

TomExMachina commented 10 months ago

It was mentioned (I think in the FAQ) that this would not be done. Not a bad idea for a fork though.