VERITAS-Observatory / EventDisplay_v4

A reconstruction and analysis pipeline for VERITAS.
BSD 3-Clause "New" or "Revised" License
4 stars 1 forks source link

Lookup table file size #145

Closed GernotMaier closed 2 years ago

GernotMaier commented 2 years ago

Current lookup tables for V6 are roughly 800 MB large. Investigate if this can be reduced.

GernotMaier commented 2 years ago

A lookup is a 2D-Histogram (TH2F*), with the dimensions log10(size), distance to telescope, and variable of interest (width, length, energy). To cover the full parameter space of observations, there lookup tables included for:

NSB=11 x Ze(9) x Woff(9) x Az(4) x Tel(4) x Var(3) x Hist(2) = 85,000 histograms

Woff = distance to comera center, Var = (width, length, energy), Hist = number of histogram required (2)

Given the file size, there are 9kB per table.

GernotMaier commented 2 years ago

Reduced lookup table file size by 25-30% by writing only the histograms required for the default 'median' option into the combined files.

I don't think anyone is using the most probable (mpv) option.

GernotMaier commented 2 years ago

Fixed with v486b.