dataverbinders / toepol

Making Dutch open data more easily accesible
0 stars 0 forks source link

How should we deal with generating unique keys in big query in combination with power bi? #18

Open Michelangelo367 opened 2 years ago

Michelangelo367 commented 2 years ago

I used left joins with for instance fields like gemeente and jaar in my views in BigQuery. I am thinking about using a generated ID that we then can use in PowerBI.

My BI / DataScience at Bank team are using multiple primary / foreign fields in relationships between tables/views, but an other team is using Generated Hash ID's (based on multiple primary keys). My team decided not using that in Databricks, because of performance issues.

https://showmethedata.blog/generating-unique-keys-in-bigquery