Open goodboy opened 1 year ago
Per https://github.com/python-trio/trio/issues/2135#issuecomment-934109228 and #359 it'd be kinda interesting to try out a couple things:
@ray.remote
ray
infect_asyncio=True
asyncio
multiprocessing
mp
Per https://github.com/python-trio/trio/issues/2135#issuecomment-934109228 and #359 it'd be kinda interesting to try out a couple things:
@ray.remote
threadray
(c++) spawning layer instead of using OS process APIs B)infect_asyncio=True
style inter-loop streaming to allow driving a remoteasyncio
task for whatever benefits it provides (if any): https://docs.ray.io/en/latest/ray-core/actors/async_api.html?highlight=async%20for#asyncio-for-remote-tasksRelvant
ray
related "actor" resources:multiprocessing
, though they're using fancy c++ threads + shm :joy: to "out-do"mp
: https://towardsdatascience.com/10x-faster-parallel-python-without-python-multiprocessing-e5017c93cce1From their actual docs: