[x] Is your feature request essential for your project?
Describe the workflow you want to enable
Currently, the intermediate csvs of regional scaling factors for urban areas and rural areas, which are the inputs of transportation electrification profile generation, are hosted in the repo. We would like to automate the data processing from source data to these csvs. Data download and processing are done in a semi manual way described in Breakthrough Energy Dropbox/BESExternalCollaborations/Transportation Electrification Modeling/VMT data processing from source data to csvs 09_20_22/
Describe your proposed implementation, if applicable
Likewise in other time series profile generation procedure, if the source data is stable, we can create a function to download the data and process on the fly, otherwise, we will host a copy of the source data in our blob storage container and go through the data intake process.
Additional context
To validate the implemented logic is correct, the csvs generated by the automatic process should be consistent with the csvs currently hosted in the repo.
:rocket:
Describe the workflow you want to enable
Currently, the intermediate csvs of regional scaling factors for urban areas and rural areas, which are the inputs of transportation electrification profile generation, are hosted in the repo. We would like to automate the data processing from source data to these csvs. Data download and processing are done in a semi manual way described in
Breakthrough Energy Dropbox/BESExternalCollaborations/Transportation Electrification Modeling/VMT data processing from source data to csvs 09_20_22/Describe your proposed implementation, if applicable
Likewise in other time series profile generation procedure, if the source data is stable, we can create a function to download the data and process on the fly, otherwise, we will host a copy of the source data in our blob storage container and go through the data intake process.
Additional context
To validate the implemented logic is correct, the csvs generated by the automatic process should be consistent with the csvs currently hosted in the repo.