search

SBNSoftware / sbnci

Packages, modules and scripts for the SBN continuous integration system
2 stars 4 forks source link

Add new comparison metrics #22

Open chilge opened 2 years ago

chilge commented 2 years ago

We currently compare reference and test validation histograms with a simple chi-squared. We should also consider adding other statistical tests that may be more appropriate when statistical fluctuations are unavoidable, e.g. the Kolmogorov–Smirnov (KS) test. The KS test has been implemented in ROOT'. See TH1::KolmogorovTest.

wesketchum commented 2 years ago

@chilge Don't know if this is on timescale for 2021C release or not: if not, we should push to the next release/sometime before the next release.

chilge commented 2 years ago

This definitely should get pushed to the next release.