Open BenGalewsky opened 5 years ago
Example 1:
Example 2:
Example 3:
Example 4:
Need to add some more links to call it done. @lukasheinrich @matthewfeickert @kratsg
Kyle Suggests that @alexander-held put ATLAS analysis code into CERN Analysis Preservation. Or work on some toy version of the analysis.
Or use the SUSY one used for the RECAST paper or Matthew's analysis if it is ready or or @kratsg 's.
pyhf configuration on HEPData
Unfortunately we're still waiting on this to get uploaded. This has been very slow, despite the dedicated followup that @kratsg has done.
Thanks!
I've updated links in #3 and #10
I added a new page to the wiki to discuss the template fit use case: https://github.com/iris-hep/project-milestones/wiki/Template-fit-use-case
Assumptions
Existing systems refers to analysis tools that existed prior to IRIS-HEP and that are currently used in LHC experiments. For example, bare ROOT, ATLAS EventLoop, CMSSW.
It should be possible to re-implement the analysis examples that are chosen by the analysis systems group for benchmarking for later comparisons.
This uses analysis use cases defined in #3.
Acceptance Criteria
A benchmark should be described by the analysis use case, the implementation details, and relevant performance metrics such as I/O throughput, even processing rates, wall clock time, and ease of use.