For transparency, I wanted to propose that we change the location of the data pipeline log file from our outputs folder (which gets archived on Zenodo) to the data_quality_metrics directory, which users can download directly from the data download page. This will help give data users transparency into the options, steps, and warnings associated with the data pipeline, if they choose to take a look at this.
I also realized that we were specifying the location of the logfile before we created all of the sub directories, so I moved the logfile configuration to after the initial code that creates the directory structure.
For transparency, I wanted to propose that we change the location of the data pipeline log file from our outputs folder (which gets archived on Zenodo) to the
data_quality_metrics
directory, which users can download directly from the data download page. This will help give data users transparency into the options, steps, and warnings associated with the data pipeline, if they choose to take a look at this.I also realized that we were specifying the location of the logfile before we created all of the sub directories, so I moved the logfile configuration to after the initial code that creates the directory structure.