PaNOSC-ViNYL / ViNYL-project

This repository keeps track of tasks, milestones, deliverables of workpackage 5 in panosc.
Apache License 2.0
5 stars 5 forks source link

Simulation database #55

Open CFGrote opened 3 years ago

CFGrote commented 3 years ago

Simulation data from wavefront propagation will be deposited in a databas(s. For a selection of instruments at EuXFEL, we perform simulations for a small number of standard setups. The wavefronts (rays) are saved in the openpmd format using the appropriate extension. Beamline instruments and their configurations as well as their corresponding simulation parameters are saved in the openpmd file as well. Depends on #56 . These files are stored in a hsds (https://www.hdfgroup.org/solutions/highly-scalable-data-service-hsds/).

The EuXFEL Xray Pulses Database (XPD) is an example.

Dependencies:

mads-bertelsen commented 3 years ago

I am afraid of this being made without many finding actual use for the feature, and unsure about who should keep the database up to date.

In order to ensure it is useful we need to consider the following:

  1. How to specify where the beam location is. Could be in coordinate system of sample position or from the source.
  2. Provide example of simulation of the instrument backend with dummy sample
  3. Source of the data, need to have access to the simulation used to create the data

A few features will also be necessary to keep the database up to date:

  1. Timing system, sources / instruments change with time. Give time window where the configuration is accurate.
  2. Need to give instrument scientists the tools necessary to update easily when something changes.
aljosahafner commented 3 years ago

@CFGrote We will need to review this issue. I don't think this is very interesting for OASYS users, as the simulations are usually not very long and users prefer interactive work anyhow. The second option is to use measured spot and properties and continue from there. However, measurements of this type are not too common and also rarely used.

CFGrote commented 3 years ago

Hi @aljosahafner and @mads-bertelsen, thanks for your comments. Indeed, I mainly wrote this from a XFEL perspective where such a feature is indeed needed. I'm ok if we focus on XFEL as a use case for this.