When operating on the full dataset, it is difficult to get the cleaning/consolidating/integrating steps to tractably function. These fix up some of the rough edges of the scripts and provide some nice config options for doing low-memory versions of the steps.
When operating on the full dataset, it is difficult to get the cleaning/consolidating/integrating steps to tractably function. These fix up some of the rough edges of the scripts and provide some nice config options for doing low-memory versions of the steps.