search

odpi / egeria-samples-api

A collection of samples illustrating the different APIs of Egeria.
Apache License 2.0
12 stars 8 forks source link

Build and catalog a reference data mapping table #11

Closed mandy-chessell closed 1 year ago

mandy-chessell commented 2 years ago

Data that comes from different sources often makes use of different units and names for the same concept. It is important to know which names are equivalent to one another, if data that is using the different names is to be combined.

Egeria provides the capability to maintain lists of values (called Valid Value Sets). This lists can then be mapped together to show the values that have the same meaning. With this type of mapping the data pipelines can accurately and consistently translate between the values used in different sources.

This task is to create one valid value set of common names for polutants, and another with these polutant's scientific name. Then map the equivant common name to its scientific name. This will allow data sets that use the common names to be combined with data sets that use the scientific names.

ellapreedy commented 2 years ago

The link to where the sample should be stored:

https://github.com/odpi/egeria-samples-api/tree/main/cataloguing-data/reference-mapping

isamatha commented 2 years ago

Can you assign this issue me and @elizajanemc. We will be working on this together.

planetf1 commented 2 years ago

@isamatha - I've assigned to you. I can add @elizajanemc if she comments on the issue first (github requires this)

elizajanemc commented 2 years ago

Hi! please assign task to me as well. Thanks!

mandy-chessell commented 2 years ago

Consider the ReferenceDataManager client.

elizajanemc commented 2 years ago

Is the goal to take the values in csv file and add to the project image?

mandy-chessell commented 2 years ago

Yes :)

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 20 days if no further activity occurs. Thank you for your contributions.