Run2.2i DR2 Release - Githubissues

heather999 commented 3 years ago

This issue is to capture the discussion concerning the preparation and validation of the DR2 release.

Prepare Pre-Release Data

Assemble Functional LSST Science Pipeline repository and determine the appropriate name for this release i.e. Run2.2i-dr2-v1

[x] calibrations, including Brighter-Fatter
[x] reference catalog
[x] ingested raws
[x] calexps
[x] coadds
[x] multiband

Catalogs

[x] Copy Object Catalogs into the shared area to a directory named: Run2.2i-dr2-v1pre/object_table_summary /global/cfs/cdirs/lsst/shared/DC2-prod/*/dpdd
[ ] Copy Metacal, if available, into the shared area in a directory named: Run2.2i-dr2-v1pre/metacal_table_summary /global/cfs/cdirs/lsst/shared/DC2-prod/*/dpdd
[x] Produce Truth Match (is there a write up for how this is done?)
[x] Copy output into shared area: /global/cfs/cdirs/lsst/shared/DC2-prod/*/truth
[x] Update GCRCatalogs for pre-release including the object catalogs, metacal, and truth match
[x] Produce DPDD Parquet using Object Catalogs Store output in the shared area: /global/cfs/cdirs/lsst/shared/DC2-prod//dpdd/Run-dr-vpre

Add-On Catalogs

[ ] Inform PZ group and request Photo-Z When available, copy into shared /global/cfs/cdirs/lsst/shared/DC2-prod/*/addons/photoz
[ ] Request generation of survey property maps using supreme When available, copy into shared /global/cfs/cdirs/lsst/shared/DC2-prod/*/addons/supreme

Validation

[ ] Run 2.2i validation notebook
[ ] Request DC2 team to take a look

Final Preparations

[x] Rename /global/cfs/cdirs/lsst/shared/DC2-prod//dpdd/Run-dr-vpre to Run-dr-v*, effectively removing the "pre" suffix, i.e. Run2.2i-dr2-v1
[x] Update or create symlink pointing to the new Run-dr-v directory, naming it Run-dr*, i.e. Run2.2i-dr2 is a symlink pointing to Run2.2i-dr2-v1
[x] Update and release GCRCatalogs including all available add-on catalogs, object cats, truth match, etc
[x] Copy LSST Science Pipelines repository to shared area
[ ] Update Data Products Page
[x] Update and tag desc-dc2-dm-data
[ ] Post announcement on Slack

katrinheitmann commented 2 years ago

@heather999 Since DC2 was released, are all those items above now done and we can close this issue? Thanks!

heather999 commented 2 years ago

I had left this open in case we ever released PZs. Maybe we have moved beyond the point of needing updated PZs for DC2 release?

johannct commented 2 years ago

@sschmidt23 @aimalz

sschmidt23 commented 2 years ago

Hmm, I thought at some point this was brought up and we decided that with photo-z's available for dr3 and dr6 (and dr6a and dr6-v2) we wouldn't bother with dr2, but maybe my recollection is wrong.