HenrikSpiegel
commented
1 year ago Added as run in simulate_x_gb.py script why it will finish before new pipelines are run.
However, the point still stands that we should split the simulation pipeline into generate_data.py, analyse_data.py
This should also allow easier conversion to new datasource in the future
4
Could be relevant to rip some parts of the pipeline which is constant (regards of gb) out and run that separately.