dataverbinders / statline-bq

Library to fetch CBS open datasets into parquet and optionally load into Google Cloud Storage and BigQuery
MIT License
0 stars 0 forks source link

Refactor (and rename) `tables_to_parquet` #48

Open galamit86 opened 3 years ago

galamit86 commented 3 years ago

Consider refactoring tables_to_parquet, currently it handles downloading of tables the conversion to parquet - ideally these processes could be separated - the majority of the issues are already handled separately, via get_odata() and convert_table_to_parquet().

Additionally - it is likely better named dataset_urls_to_parquet, or urls_to_parquet if kept together.