Talent-Catalog / talentcatalog

https://tctalent.org
GNU Affero General Public License v3.0
13 stars 4 forks source link

Flatten anonymized data #1659

Open camerojo opened 19 hours ago

camerojo commented 19 hours ago

Our data comes from a relational database (postgres).

The anonymized data needs to be converted to an object form so that it is self contained and does not rely on any external lookups.

This already happens to some extent because our DTO's are constructed from a JPA entity which is an object created from links to multiple table relationships.

So, for example, a country field of a candidate (eg location or nationality) appears in the DTO as a country property with an id field and a name field.

For the anonymized data, the id is meaningless to anyone external (being a random internal database primary key of the Country table). We also need the two character ISO code (as well as the name for convenience) in the anonymized data.

Another example is occupations where, for external use, we need the ISCO08 code.

camerojo commented 17 hours ago