Remove temp folders when done

dataverbinders / statline-bq

Library to fetch CBS open datasets into parquet and optionally load into Google Cloud Storage and BigQuery

MIT License

0 stars 0 forks source link

Remove temp folders when done #42

Closed galamit86 closed 3 years ago

galamit86 commented 3 years ago

Currently, statline_bq/temp/{source}/{odata_version}/{dataset_id}/json folder is emptied but remains as empty folder, and statline_bq/temp/{source}/{odata_version}/{dataset_id}/parquet folder remains full.

Both should be emptied and deleted at end of process.