search

LineaLabs / lineapy

Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.
https://lineapy.org
Apache License 2.0
662 stars 58 forks source link

Support asynchronous evaluation (for IPython 7+) #72

Open yifanwu opened 3 years ago

yifanwu commented 3 years ago

Currently, everything in lineapy is synchronous. However the Python world is changing (asyncio now being a built in library). We should at some point consider it for good eng practice (along with multi-threading).

This optimization would otherwise NOT be on the critical path if not for the fact that newer versions of JupyterLab expects the cell execution functions to be async. This blog post explains more their rationale for using it.

We should investigate the scope to which this applies---our design partners might still be on older versions of Jupyters.

saulshanabrook commented 2 years ago

There are maybe two ways we can support async:

  1. Support understanding user's async code
  2. Rewriting our code to use async

I think this is talking about the second?