LineaLabs / lineapy

Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.
https://lineapy.org
Apache License 2.0
662 stars 58 forks source link

LIN-620 Combine three notebooks into one to generate an Airflow DAG that executes #792

Closed yoonspark closed 1 year ago

yoonspark commented 1 year ago

Summary

Given that the current three-notebook example produces an Airflow DAG that cannot be run (due to inclusion of lineapy.get() in the module file), we decided, for now, to combine them into a single notebook. This has already been done in linea-platform-demo repo, so this task is for simply updating the counterpart in lineapy.

Changes

Testing

CI will test notebook runs.

Ticket(s)