HYPERNETS / hypernets_processor

Processor for Hypernets field data to generate the user products
9 stars 3 forks source link

Update metadata while creating files #36

Closed clemgoyens closed 6 months ago

clemgoyens commented 4 years ago

Currently metadata comes from metadata.py. Need to be updated according to raw data, metadata and config file

shunt16 commented 4 years ago

As you say, in terms of sources of metadata I think we have 3 sources: (1) Metadata database we have to query (2) The run config files (3) Information in the raw data files

I think the steps for doing this are: (i) Get the info from (1) and (2) before reading the raw data (ii) Get the info from (3) in your reader (iii) Your reader hands (1), (2) and (3) to the hypernets_dsbuilder which adds the metadata to the dataset

So I can look at (i) and (iii), while you look at (ii)?

shunt16 commented 4 years ago

Created a separate issue (#39) for (1) above

clemgoyens commented 4 years ago

OK I handle (ii)! Still missing:

shunt16 commented 4 years ago

Implementation set up to do this now, by HypernetsDSBuilder querying metadata database when creating template. Waiting for creation of metadata databases (#39) for completion.