Remove temp dir - Githubissues

dataverbinders / statline-bq

Library to fetch CBS open datasets into parquet and optionally load into Google Cloud Storage and BigQuery

MIT License

0 stars 0 forks source link

Closed galamit86 closed 3 years ago

galamit86 commented 3 years ago

This PR:

Implements a higher level removal of temp folder and end of process: local_temp_folder/[source]/[odata_version]/[dataset_id] is removed, instead of: local_temp_folder/[source]/[odata_version]/[dataset_id]/[upload_date]
Returns a Path item for this folder when running main to use for clean up in nl-open-data flow implementation.