search

Overv / outrun

Execute a local command using the processing power of another Linux machine.
Apache License 2.0
3.12k stars 64 forks source link

Wrap outrun and use it as decorator #13

Open hugocatlas opened 3 years ago

hugocatlas commented 3 years ago

Dear outrun dev team,

Just bumped into this awesome tool and I'd like to send kudos to the dev team for implementing it. I was wondering: would it be imaginable to allow outrun to be used as a Python decorator? Imagine I'm working in a Jupyter Notebook in one cloud machine that is very small but ok for notebooking. Now imagine that one of my analysis Python (or wrapped in Python code) functions requires a significant amount of computing power that is not available on the machine I'm working on. In my work environment, it's very simple for me to fire-up a more powerful machine, but this requires me to migrate my notebook to this new machine. However, if I could just decorate my computing function in my notebook indicating that it has to run in another machine, this would make my life 1000x easier.

It would be extremely helpful if outrun could support this use case. How does it sound?

Cheers,

Hugo

setop commented 3 years ago

You may have a look at https://dask.org/ which is designed for distributed dataframe.

hugocatlas commented 3 years ago

You may have a look at https://dask.org/ which is designed for distributed dataframe.

I know Dask but the use case I described goes way beyond the scope of dataframes...