search

simonsobs / map_based_simulations

Map based simulations for the Simons Observatory
4 stars 1 forks source link

Websky CIB simulations at more frequencies #17

Closed zonca closed 2 years ago

zonca commented 5 years ago

@marcelo-alvarez here are the currently available CIB frequencies:

https://portal.nersc.gov/project/cmb/so_pysm_models_data/websky/0.3/

I'm now running with bandpasses (#12), and the lower channel gets down to 21.7GHz. Can you please extend the WebSky CIB until 20 or 21 GHz?

Also, it would be nice to add a few more frequencies also between channels, so that the interpolation is not across a wide frequency range.

zonca commented 5 years ago

Here is the latest table of bandpasses:

Screenshot 2019-07-03 at 01 33 47

marcelo-alvarez commented 5 years ago

@zonca -- I am in the process of updating / improving the CIB model in websky to correct a bug in the treatment of satellite galaxies. Would it be acceptable to use this updated model for this?

zonca commented 5 years ago

Yes

zonca commented 5 years ago

@marcelo-alvarez @msyriac as discussed today at the FG call, it would be nice to have more CIB maps.

Choose the number of points in frequency

But not too many! The problem is that if PySM is being used for multiple channels, we need to keep these maps in memory as we loop through channels, so impact on memory consumption is high. PySM does integration with trapz, so basically linear interpolation, how does the CIB differ from linear interpolation? if not too much, I would limit just to ~5 maps for each channel, [low, low-mid, mid, high-mid, high], in any case keep them equally spaced in the bandwidth, i.e. I would remove maps too close to the center freq (like 91 GHz and 93 GHz for the 92 GHz channel).

Choose the frequencies

The table above gives center frequency and bandwidth, it would be nice to have simulations just below and just above the boundary of each frequency channel, e.g. 92 GHz, bandwidth is 26 GHz, so lower boundary is 79 GHz, maybe we do 10% of the bandwidth lower, like 76 GHz?

msyriac commented 5 years ago

Perhaps we can do a test where we bandpass integrate ~545 GHz and/or ~353 GHz websky cib maps with the Planck bandpass for a few versus a dozen and compare the final maps.

marcelo-alvarez commented 5 years ago

@msyriac would it be useful to generate an update to the table above to contain all the frequencies we need (i.e. including ACT, Planck, ..)? then I could run the 5 maps per channel as @zonca suggested.

marcelo-alvarez commented 5 years ago

@zonca wrote:

PySM does integration with trapz, so basically linear interpolation, how does the CIB differ from linear interpolation?

we have not investigated this in detail. it's also not clear exactly what statistic to use for answering 'how does the CIB differ from linear interpolation?' qualitatively. @msyriac @jcolinhill any thoughts on this? for now I will run 5 maps per frquencies channel once we have specified the frequencies and band edges.

jcolinhill commented 5 years ago

I agree with Mat's suggestion of comparing a 5-map interpolation to a >>5 map interpolation. We could just look at difference maps afterward, and see how large any residuals are. Also power spectra etc

zonca commented 5 years ago

@marcelo-alvarez would you have any update on this?

marcelo-alvarez commented 5 years ago

We have now validated the revised CIB model and are in the process of generating CIB maps at a range of frequencies near 353 and 545. @msyriac, what frequency range should I sample in for these two?

marcelo-alvarez commented 5 years ago

In the meantime we will sample with 5 maps per frequency band in the table above.

marcelo-alvarez commented 5 years ago

@zonca are the following frequencies acceptable? Values and plot were generated by @msyriac

[21.6, 24.47, 27.33, 30, 35.93, 41.67, 44, 47.4, 63.9, 67.8, 70, 73.7, 79.6, 90.16, 100, 111.49, 128.99, 143, 152.65, 164.48, 188.56, 210.29, 217, 232.03, 256.0, 275.17, 294.33, 305.84, 313.5, 340.21, 353, 374.59, 408.96, 466.56, 525.36, 545, 584.17, 642.97, 728.93, 817.39, 857, 905.86, 994.32]

2019-10-02_16_13_14

zonca commented 5 years ago

Can we add one point above and one below at about the same spacing? Also what about rounding to nearest integer frequency?

marcelo-alvarez commented 5 years ago

I added one above and one below, and rounded to 3 significant digits:

[18.7, 21.6, 24.5, 27.3, 30.0, 35.9, 41.7, 44.0, 47.4, 63.9, 67.8, 70.0, 73.7, 79.6, 90.2, 100, 111, 129, 143, 153, 164, 189, 210, 217, 232, 256, 275, 294, 306, 314, 340, 353, 375, 409, 467, 525, 545, 584, 643, 729, 817, 857, 906, 994, 1080]

zonca commented 5 years ago

It would be interesting to plot this: how many points would a 20% and a 30% bandwidth require to read as a function of frequency?

marcelo-alvarez commented 5 years ago

It looks like it should always be less than about five, by construction, since @msyriac chose 5 channels per band.

zonca commented 5 years ago

Ok, I'll cross-check that but you can go ahead and produce them at 8192

zonca commented 4 years ago

@marcelo-alvarez any news about this? do we have the 8192 maps at the frequencies above?

marcelo-alvarez commented 4 years ago

We don't yet have these CIB + Radio maps, @xzackli can you produce these with your xgpaint version? I will produce kSZ and tSZ with the latest websky.

xzackli commented 4 years ago

Back from vacation, I'll produce these maps.

zonca commented 4 years ago

@xzackli @marcelo-alvarez do you have the maps at nside 8192? are they available at NERSC?

xzackli commented 4 years ago

I'll move them to NERSC and send you the directory this weekend, they've been sitting on tigress. If you have tigress access, they are at /tigress/zequnl/xgpaint/jl/cib. I'll also make some plots! Sorry for taking a while.

zonca commented 4 years ago

@xzackli do you have any update on this?

xzackli commented 4 years ago

I found it really annoying to rsync the files over, so instead I ran my code on the NERSC cluster. Cori has slow IO, so I don't know if I really saved time. The maps are in my scratch, and all groups have r permissions.

/global/cscratch1/sd/xzackli/cib/share
zonca commented 4 years ago

@xzackli I get permission denied

zonca commented 4 years ago

@xzackli I still get permission denied, you should make your scratch folder readable and executable by the simonsobs group:

ls -ld /global/cscratch1/sd/xzackli/
drwx------ 9 xzackli xzackli 12288 Feb 21 05:14 /global/cscratch1/sd/xzackli/
xzackli commented 4 years ago

This is terribly embarrassing for me, I must have set the wrong string of numbers. I've applied 777 for now, and I'll look into how to set the right permissions.

zonca commented 4 years ago

no worries, unix permissions are an ancient awkward thing.

you need to fix permissions also for the root folder:

ls -ld /global/cscratch1/sd/xzackli/
drwx------ 9 xzackli xzackli 12288 Feb 21 05:14 /global/cscratch1/sd/xzackli/
xzackli commented 4 years ago

Done! 

ls -ld /global/cscratch1/sd/xzackli/
drwxrwxrwx 9 xzackli xzackli 12288 Feb 21 05:14 /global/cscratch1/sd/xzackli/
zonca commented 4 years ago

ls -ld /gl obal/cscratch1/sd/xzackli/cib drwxrwx--- 3 xzackli xzackli 4096 Feb 19 09:39 /global/cscratch1/sd/xzackli/cib

On Wed, Mar 11, 2020 at 1:27 PM Zack Li notifications@github.com wrote:

Done!

ls -ld /global/cscratch1/sd/xzackli/ drwxrwxrwx 9 xzackli xzackli 12288 Feb 21 05:14 /global/cscratch1/sd/xzackli/

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/simonsobs/map_based_simulations/issues/17#issuecomment-597857953, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC5Q4RXCCLBRAOGDTMMO3TRG7X3VANCNFSM4H5AT4LA .

xzackli commented 4 years ago

Ok, I've set the permissions on every parent directory.

ls -ld /global/cscratch1/sd/xzackli/
drwxrwxrwx 9 xzackli xzackli 12288 Feb 21 05:14 /global/cscratch1/sd/xzackli/
ls -ld /global/cscratch1/sd/xzackli/cib
drwxrwxrwx 3 xzackli xzackli 4096 Feb 19 09:39 /global/cscratch1/sd/xzackli/cib
ls -ld /global/cscratch1/sd/xzackli/cib/share
drwxrwxrwx 2 xzackli xzackli 4096 Feb 19 09:29 /global/cscratch1/sd/xzackli/cib/share
ls -ld /global/cscratch1/sd/xzackli/cib/share/cib_100.fits
-rwxrwxrwx 1 xzackli xzackli 3221233920 Feb 19 08:50 /global/cscratch1/sd/xzackli/cib/share/cib_100.fits
xzackli commented 4 years ago

This discussion has reminded me that I was going to adjust the amplitude of the maps to match Planck (i.e. multiplying every map by some number). What's the path for updating these data products?

xzackli commented 4 years ago

@mhasself just taught me how to use Linux permissions, and I've set the cib directory to the sobs group.

zonca commented 4 years ago

ok, got the files, thanks

On Wed, Mar 11, 2020 at 1:52 PM Zack Li notifications@github.com wrote:

@mhasself https://github.com/mhasself just taught me how to use Linux permissions, and I've set the cib directory to the sobs group.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/simonsobs/map_based_simulations/issues/17#issuecomment-597872959, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC5Q4UZAOIE2GDG637G2WTRG722XANCNFSM4H5AT4LA .