Protocol for comparison of raw simulated to raw experimental data

PaNOSC-ViNYL / ViNYL-project

This repository keeps track of tasks, milestones, deliverables of workpackage 5 in panosc.

Apache License 2.0

5 stars 5 forks source link

Open CFGrote opened 3 years ago

CFGrote commented 3 years ago

As a first step, perform a literature survey on established best practises for sim-exp benchmarking and comparisons.

Which metrics are applied
What are the categories to characterize accuracy/"closeness to experiment" performance of a simulation code.
How to compare noisy data against noisy data?

mads-bertelsen commented 3 years ago

A few considerations to this important topic

Should we narrow the focus to cases with same binning (simulation can always be set to real detector binning), or consider how to compare data with different binnings?
Is there a way to compare event data that was never in a histogram to begin with?
Assuming we find a systematic way to do this comparison, how do we implement it? As a little library we all use in ViNYL?

JunCEEE commented 3 years ago

The slides are uploaded.

JunCEEE commented 3 years ago

This is currently delayed due to the NeXus format issue.