desihub / desispec

DESI spectral pipeline
BSD 3-Clause "New" or "Revised" License
35 stars 24 forks source link

expand zcat minimal columns #2185

Closed sbailey closed 6 months ago

sbailey commented 6 months ago

desi_zcatalog --minimal ... includes only a minimal set of fibermap columns in the stacked redshift catalogs instead of all 100+ columns. It turns out the current default set is so minimal that it doesn't even in include the columns needed to determine unique spectra and trace back to their parent coadd/spectra files. This PR adds those additional columns: TILEID, LASTNIGHT, HEALPIX, SURVEY, PROGRAM, with existence-checks because e.g. healpix-based files don't have a TILEID column.

This is not intended to be the final answer for the ongoing discussion about paring down the zcatalog columns to make the files a more manageable size. It's just adding the columns needed for uniqueness, which should have been in the --minimal set in the first place. I needed this while assembling catalogs for evaluating Redrock PR #282 (5sigma negative flux masking).