dataverbinders nl-open-data issues

dataverbinders / nl-open-data

A Flexible Python ETL toolkit for datawarehousing framework based on Dask, Prefect and the pydata stack

https://dkapitan.github.io/nl-open-data

MIT License

0 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Run full CBS core and external flows

#108 galamit86 opened 2 years ago
1
convert config to box

#107 galamit86 opened 2 years ago
0
UWV Open Match data

#106 galamit86 closed 3 years ago
2
Failed to create dataset in dataverbinders-open-dwh and save view in existing dataset

#105 Michelangelo367 closed 3 years ago
2
read space-delimited table with spaces in the values

#104 galamit86 closed 3 years ago
2
Nested mapping

#103 galamit86 closed 3 years ago
4
Statline refactoring

#102 galamit86 closed 3 years ago
0
Gcs to bq flows

#100 galamit86 closed 3 years ago
0
Parquet error . character not supported yet for Table Gebieden in Nederland (_DataProperties)

#99 Michelangelo367 closed 3 years ago
1
Box config

#98 galamit86 closed 3 years ago
0
DataProperties.parquet.Reading . such fields is not yet supported

#97 Michelangelo367 closed 3 years ago
1
Get error while connecting python with bigquery

#95 Michelangelo367 closed 3 years ago
26
Cannot create a serviceaccount in GCP

#94 Michelangelo367 closed 3 years ago
13
Lookup table with all the Tabelinformatie of all tables

#93 Michelangelo367 closed 3 years ago
3
Which table(s) to use in BQ: Gemeentelijke indelingen per jaar - 1991-2021

#92 Michelangelo367 closed 3 years ago
2
Some v4 datasets have duplicate values

#91 galamit86 opened 3 years ago
0
raise SKIP in prefect for skipped datasets

#90 galamit86 closed 3 years ago
0
Remove temp dir if `main` fails in `statline_bq` flow

#89 galamit86 closed 3 years ago
0
Data modelling

#88 galamit86 opened 3 years ago
15
Cbs external flows

#87 galamit86 closed 3 years ago
0
Map statline main

#86 galamit86 closed 3 years ago
0
Providing config object through a `run_script` throws error

#85 galamit86 opened 3 years ago
0
Optimize performance VM: try Zonal SSD PD

#84 dkapitan opened 3 years ago
2
dataplatform.nl ontsluiten als nieuwe dataportaal

#83 dkapitan opened 3 years ago
0
Cbs helper datamart, plus extras

#82 galamit86 closed 3 years ago
0
Clean up task

#81 galamit86 closed 3 years ago
0
Use new project setup

#80 galamit86 closed 3 years ago
0
clean up task not working properly

#79 galamit86 closed 3 years ago
0
tables_to_parquet() fails sporadically for large datasets

#78 galamit86 opened 3 years ago
7
Use Supervisor to ensure long running flows

#77 galamit86 closed 3 years ago
4
New production naming conventions

#76 galamit86 closed 3 years ago
0
Mirror statline

#75 galamit86 closed 3 years ago
0
Flow history analysis

#74 galamit86 opened 3 years ago
1
Flow analysis

#73 galamit86 closed 3 years ago
0
Handle VM shutdown better

#72 galamit86 opened 3 years ago
4
Add source data mapping postcode-huisnummer --> wijk en buurt for multiple years

#71 dkapitan opened 3 years ago
0
Add CBS dataset in `dataverbinders-datamart`

#70 dkapitan opened 3 years ago
1
fix `odata.type` column name in parquet files

#69 dkapitan closed 3 years ago
1
Improve naming conventions for production

#68 dkapitan closed 3 years ago
6
Ensure a dataset is uploaded once it is converted

#67 galamit86 closed 3 years ago
2
Consider a better implementation for source

#66 galamit86 opened 3 years ago
2
remove auto capitalization

#65 galamit86 closed 3 years ago
0
Arrange folders

#64 galamit86 closed 3 years ago
3
Automate VM usage

#63 galamit86 opened 3 years ago
1
Local dask deployment

#62 galamit86 closed 3 years ago
0
Pythonize field names

#61 galamit86 closed 3 years ago
3
Document onboarding process for clients

#60 galamit86 opened 3 years ago
1
Use script based storage

#59 galamit86 opened 3 years ago
0
Possibly use deepnote as agent

#58 dkapitan opened 3 years ago
2
Configure access from service accounts properly

#57 dkapitan closed 3 years ago
1