search

simonsobs / SOLikeT

SO Likelihoods and Theories
https://soliket.readthedocs.io/
MIT License
12 stars 15 forks source link

Create unified sacc file for tests data #31

Open itrharrison opened 3 years ago

itrharrison commented 3 years ago

At the moment there are a number of tests which are run using data files from different simulations. See the list below.

Eventually these simulations should be as coherent as possible.

For now I will check which of these data files are actually used and collect them together into a single sacc file which is used by the tests.

The list of data files I can see are:

soliket/data/simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109/
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_binned_covmat.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_00_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_01_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_02_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_03_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_04_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_05_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_06_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_07_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_08_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_09_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_10_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_11_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_12_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_13_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_14_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_15_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_16_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_17_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_18_bandpowers.txt
    simulated_clkk_SO_Apr17_mv_nlkk_deproj0_SENS1_fsky_16000_iterOn_20191109_sim_19_bandpowers.txt

soliket/data/xcorr_simulated/
    clgg_noiseless.txt
    clkg_noiseless.txt
    dndz.txt

soliket/clusters/data/
    ACTPol_Cond_scatv5.fits
    E-D56Clusters.fits
    selFn_equD56/
        QFit.fits
        RMSMap_Arnaud_M2e14_z0p4.fits.gz
        RMSTab.fits
        areaMask.fits.gz
        fRelWeights.fits

soliket/lensing/data/
    binnedauto.txt
    binnedcov.txt
    binningmatrix.txt
timothydmorton commented 3 years ago

Separate from data included in this repo, there is also test data for some likelihoods that gets pulled in via the InstallableLikelihood functionality, e.g. for lensing here:

https://github.com/simonsobs/SOLikeT/blob/9a80163da3bb5dada70217811d0a4d53aa391a41/soliket/lensing/lensing.py#L15

and for MFLike as well. So any pattern that tries to address simulated test data in a unified way needs to include those, too.

itrharrison commented 2 years ago

We also discussed another place which should switch to sacc. In the multi-Gaussian likelihood, which currently assumes Cls stored as .npy files:

https://github.com/simonsobs/SOLikeT/blob/308bd61e544bc543d20e3ec6f35400b2784e34fc/soliket/gaussian.py#L43