search

LSSTDESC / DC2-production

Configuration, production, validation specifications and tools for the DC2 Data Set.
BSD 3-Clause "New" or "Revised" License
11 stars 7 forks source link

Issues/337 #353

Closed wmwv closed 5 years ago

wmwv commented 5 years ago

Generate DIA Object table. Compute variability statistics from DIA Source GCR catalog.

Specifically for Run 1.2p test. Files installed at NERSC.

Verification Notebook to demonstrate that DIA Source and DIA Object are reasonable. (and yes, an enhanced version of this notebook will be added to DC2-analysis soon.)

wmwv commented 5 years ago

Note that the loading and processing of the DIA Object statistics is currently pessimal and takes a ridiculously long time. This should be improved for the future, but much of that work should likely happen with dia_pipe in the association driver rather than in the processing here.

wmwv commented 5 years ago

Thanks, @yymao . I created a new section for the DIA table creation because the relationship between DIASource and DIAObject tables is fundamentally different than that between Source and Object tables.