AI-multimodal / aimmdb

BSD 3-Clause "New" or "Revised" License
0 stars 10 forks source link

Revisit the use of "dataset" #38

Open danielballan opened 1 year ago

danielballan commented 1 year ago

We use "dataset" to group all the NMC data, but elsewhere we use it to group different batches of data (iss, iss-raw). It seems like we need mechanisms for grouping data by its {source, origin, contributor, batch?} and other for grouping data that we are interested in analyzing together (NMC).

danielballan commented 1 year ago

Decision (discussion with @jmaruland and @danielballan):

At some point, take the nodes that currently have dataset="nmc" and edit their dataset (probably directly in a mongo shell at this point) to refer to a batch and add {"projects": ["nmc"]} to everything that relates to NMC.

danielballan commented 1 year ago

We also want to capture measurement type, like hard XAS or soft XAS or a simulated version of those....