singularity-energy / open-grid-emissions

Tools for producing high-quality hourly generation and emissions data for U.S. electric grids
MIT License
67 stars 4 forks source link

Change logfile location to data quality metrics results #291

Closed grgmiller closed 1 year ago

grgmiller commented 1 year ago

For transparency, I wanted to propose that we change the location of the data pipeline log file from our outputs folder (which gets archived on Zenodo) to the data_quality_metrics directory, which users can download directly from the data download page. This will help give data users transparency into the options, steps, and warnings associated with the data pipeline, if they choose to take a look at this.

I also realized that we were specifying the location of the logfile before we created all of the sub directories, so I moved the logfile configuration to after the initial code that creates the directory structure.

miloknowles commented 1 year ago

@grgmiller FYI, the function that configures the logger will create the necessary subdirectories that it needs, so the order shouldn't actually matter

grgmiller commented 1 year ago

Ok thanks! I moved the order back to its original order.