LSSTDESC / skyCatalogs

Create sky catalogs and provide access via API
BSD 3-Clause "New" or "Revised" License
6 stars 5 forks source link

TRILEGAL support #118

Open JoanneBogart opened 3 weeks ago

JoanneBogart commented 3 weeks ago

TRILEGAL star properties may be obtained from Astro Data Lab. See available quantities at https://datalab.noirlab.edu/query.php?name=lsst_sim.simdr2. As compared to the information available to skyCatalogs when producing catalogs of stars from other simulations, the following inputs are missing:

Since there is concern that many parallel processes accessing the db during simulation could cause too much contention, we are currently planning to first create skyCatalogs main catalogs for TRILEGAL stars (parquet files, partitioned by healpixel; adding a column for a unique id in the process) by querying the database, then from that create SEDs (probably hdf5, also one per healpixel), and finally create (parquet) flux files.

Uncompressed hdf5 SED files could amount to about 50 Tbytes total (LSST footprint) but should compress down to about 3 Tbytes. Parquet files per healpixel would be similar to the ones produced now for DC2 stars.

cahebert commented 3 weeks ago

The lsst_sim stellar catalog (generated with TRILEGAL) is described in detail in this paper.

sidneymau commented 3 weeks ago

I know Claire has also done some work on producing spectra for the lsst_sim stars, but I thought these figures may be relevant to this conversation. A few notes:

image image image

cahebert commented 2 weeks ago

Thanks for these plots, Sid. I think the plan is to use BT-Settl.

I'd done a similar comparison on a sample of 5000 stars (label=1 but sampled randomly across the sky), using pystellibs to produce the spectra. The lsst_sim catalog was generated with the O'Donnell 1994 dust model (O94 in dust_extinction), so I used that here, but I checked with the G23 model you used above and the difference was minimal.

Something funky is going on with Phoenix: >50% of rmag values are >1.5mag fainter than lsst_sim! Haven't looked much into where this is coming from, since the BT-Settl results looks good and it probably makes sense to use the same library that was used to generate the stellar catalog in the first place. lsstsim-colormag-compare-mainseq