Open hugocatlas opened 3 years ago
You may have a look at https://dask.org/ which is designed for distributed dataframe.
You may have a look at https://dask.org/ which is designed for distributed dataframe.
I know Dask but the use case I described goes way beyond the scope of dataframes...
Dear outrun dev team,
Just bumped into this awesome tool and I'd like to send kudos to the dev team for implementing it. I was wondering: would it be imaginable to allow outrun to be used as a Python decorator? Imagine I'm working in a Jupyter Notebook in one cloud machine that is very small but ok for notebooking. Now imagine that one of my analysis Python (or wrapped in Python code) functions requires a significant amount of computing power that is not available on the machine I'm working on. In my work environment, it's very simple for me to fire-up a more powerful machine, but this requires me to migrate my notebook to this new machine. However, if I could just decorate my computing function in my notebook indicating that it has to run in another machine, this would make my life 1000x easier.
It would be extremely helpful if outrun could support this use case. How does it sound?
Cheers,
Hugo