CityOfLosAngeles / aqueduct

A shared pipeline for building ETLs and batch jobs that we run at the City of LA for Data Science Projects. Built on Apache Airflow & Civis Platform
Apache License 2.0
21 stars 6 forks source link

Util package #314

Closed ian-r-rose closed 4 years ago

ian-r-rose commented 4 years ago

This adds the skeleton of a utility package for aqueduct-related python code. The idea is if we have commonly used code snippets that need to be imported across a number of jobs, having them in a centrally installed python package is nicer to work with than munging about with sys.path or similar.

It's mostly empty at the moment, except that I have added a somewhat self-serving nbextension that allows notebook users to open JupyterLab in a new tab if they prefer.

hunterowens commented 4 years ago

@akoebs to review