open-contracting / kingfisher-summarize

Creates SQL tables that summarize the OCDS data in collections from Kingfisher Process
https://kingfisher-summarize.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
3 stars 8 forks source link

agg_parties: Ignore invalid roles #193

Closed jpmckinney closed 2 months ago

jpmckinney commented 3 years ago

Some publishers have roles as an object instead of an array. Ideally, we can just ignore bad data.

I did a naive attempt in https://github.com/open-contracting/kingfisher-summarize/pull/192 but I'm assuming you can't have a case statement inside a join statement.

duncandewhurst commented 3 years ago

What is the current behaviour and what problems does it cause?

jpmckinney commented 3 years ago

I think an error is raised. We can create a test case and see what happens.