Impress the celery crowd

[goodboy]

After a great in depth convo with @ryanhiebert, it seems we may need to drum up some examples to compare and contrast how tractor is a lower level system in comparison to celery / amqp and can be used to build such load balancer patterns. A more general actor model system like tractor or a scalability protocols system like zeromq considers such patterns special cases. Emphasis on SC in these examples should be paramount.

I'd also like to glean everything from those communities that can be used at the "tractor level". I've already noted a few things:

• the celery remote debugger, something I've already mentioned in the docs
• the supposed improvements to multiprocessing.pool that were added in billiard
• tasktiger seems interesting as a celery competitor

I'd like to use this issue to track the discourse surrounding how tractor can support the needs of (ex) celery users who are looking for a SC alternative.

[auvipy]

I am a core team member of the celery. we are investing trio based alternative for billiard or multiprocessing for celery 5.

[ryanhiebert]

Hi @auvipy! I've seen your posting about that, it's quite neat! As far as a mp alternative, I've recently come across https://github.com/ethereum/trio-run-in-process which may have some of that work that's in a state worth checking out. I'd love to hear your thoughts on it! I'm still kicking the tires myself, and @goodboy has been seeing if he can work it into tractor, to see if it's a good fit. It lacks polish and documentation, but might be a place to start.

[auvipy]

thanks for the pointer! I will check it for sure. seems both projects can be benefited from each other!

[goodboy]

See #115 for further discussion on progress towards a pure trio process spawning backend.