openownership / register

A demonstration transnational register of beneficial ownership data from the UK, Denmark, Slovakia and Armenia
https://register.openownership.org
GNU Affero General Public License v3.0
18 stars 3 forks source link

Null source_descriptions in register data #208

Open miranda-ae opened 11 months ago

miranda-ae commented 11 months ago

Not sure if this is the right place for this but it appears that most entity_statements are missing source_descriptions. Of c. 9.7m statements only 500k have source_descriptions, and all of those are GB Persons Of Significant Control Register - none for DK or SK.

StephenAbbott commented 11 months ago

@tiredpixel When you get time to look at this, guessing that the issue lies in https://github.com/openownership/register-sources-bods ? But we need to dig into it more.

source_description field is present for just 572,954 out of the present 9,197,122 entity statements in UK PSC data https://bods-data.openownership.org/source/UK_PSC/ (same number reported for source_type, source_url, source_retrievedAt and source_assertedBy too in UK PSC).

All source fields are completely absent from entity_statement table in Denmark data source according to our BODS data analysis tools https://bods-data.openownership.org/source/denmark/

All source fields are also completely absent from entity_statement table in Slovakia data source according to our BODS data analysis tools https://bods-data.openownership.org/source/slovakia/

Source fields for both person statements and ownership-or-control statements from Denmark and Slovakia data sources are present in the data and available for every one of the statements of those types - just not for entity statements.