analyst-collective / analytics

Open source data models and analysis.
Apache License 2.0
46 stars 11 forks source link

Mechanism for creating and populating tables #9

Open jthandy opened 8 years ago

jthandy commented 8 years ago

There are multiple examples where we want to supply supplemental data to be joined in with data used for analysis:

In order to deal with this, we need a procedural way to build and tear down datasets that is 100% integrated into the way we're deploying models. This should likely look like a python script that is integrated into runner.py, and runs multiple python files, each of them responsible for building or tearing down a particular table. Some tables will be best built via code and some will be best loaded from a CSV, so it should be flexible enough to handle multiple methods of data population.

jthandy commented 8 years ago

@drewbanin this is still a very useful thing to solve.