Closed miloknowles closed 1 year ago
FWIW, the --small
option only works right now if you also do --flat
so that EIA-930 cleaning is skipped.
Thanks, Milo. I'll take a look. I think that maybe we may get rid of the -small argument altogether as part of our upcoming infrastructure improvements, so not sure if it is worth our time to update it further.
Thanks, Milo. I'll take a look. I think that maybe we may get rid of the -small argument altogether as part of our upcoming infrastructure improvements, so not sure if it is worth our time to update it further.
I think having a --small
option is still useful for testing and debugging. Currently, I'm using it as a faster way to test out a CI/CD pipeline for OGE.
I was originally debugging the
--small
option for the data pipeline, which crashes at the EIA-930 cleaning step. During that process, I made a couple improvements to how command line arguments are handled indata_pipeline.py
:--small
,--flat
, and--skip_outputs
don't need a value after them any more. If you omit these arguments, the default is used. If you include--small
, that value will be true. This is to be more consistent with other command line interfaces.EDIT: Added one more change to this PR: