search

simonsobs / map_based_simulations

Map based simulations for the Simons Observatory
4 stars 1 forks source link

Noise simulations directly in CAR #28

Closed zonca closed 4 years ago

zonca commented 5 years ago

For noise, can someone volunteer to make a pull request to https://github.com/simonsobs/mapsims/blob/master/mapsims/noise.py to generate noise in CAR? I'll then run the sims. You need to install pysm 3 from github.com/healpy/pysm (clone master and pip install . it)

_Originally posted by @zonca in https://github.com/simonsobs/map_based_simulations/issues/13#issuecomment-503068349_

zonca commented 5 years ago

basically replace synalm at https://github.com/simonsobs/mapsims/blob/master/mapsims/noise.py#L200 with the equivalent in pixell

msyriac commented 4 years ago

I'm working on this. Is it alright if I do this in the same PR as the splits issue #30 ?

zonca commented 4 years ago

Yes, thanks

On Fri, Jan 10, 2020, 07:30 Mathew S. Madhavacheril < notifications@github.com> wrote:

I'm working on this. Is it alright if I do this in the same PR as the splits issue #30 https://github.com/simonsobs/map_based_simulations/issues/30 ?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/simonsobs/map_based_simulations/issues/28?email_source=notifications&email_token=AAC5Q4T3YTBFC4BKFY6GGI3Q5CIA3A5CNFSM4JKJCYVKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEIUIQCI#issuecomment-573081609, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC5Q4QFM4PT6QR7OYQ5DY3Q5CIA3ANCNFSM4JKJCYVA .

msyriac commented 4 years ago

For the hitmaps, I would like to provide a set of CAR templates at pre-defined resolutions (corresponding to those decided in #18 ). Since the resolution prescriptions might change in the future and since the hitmaps are not final either, I don't think it's a good idea to keep this in the git tree. Do you have a recommendation for a way to store and download these hitmaps as needed? @zonca

zonca commented 4 years ago

Yes, let's keep them in a dedicated repo using git lfs, then have them checked out in /project www and served via http. Like so_pysm_models templates

On Fri, Jan 10, 2020, 09:37 Mathew S. Madhavacheril < notifications@github.com> wrote:

For the hitmaps, I would like to provide a set of CAR templates at pre-defined resolutions (corresponding to those decided in #18 https://github.com/simonsobs/map_based_simulations/issues/18 ). Since the resolution prescriptions might change in the future and since the hitmaps are not final either, I don't think it's a good idea to keep this in the git tree. Do you have a recommendation for a way to store and download these hitmaps as needed?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/simonsobs/map_based_simulations/issues/28?email_source=notifications&email_token=AAC5Q4V6X3B6WANEZRQG6BDQ5CW7DA5CNFSM4JKJCYVKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEIUVB3Q#issuecomment-573133038, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC5Q4UCB2VH4VLF6O5MUETQ5CW7DANCNFSM4JKJCYVA .

msyriac commented 4 years ago

I couldn't find this done in so_pysm_models. Could you point me to it?

zonca commented 4 years ago

https://github.com/simonsobs/so_pysm_models/blob/master/so_pysm_models/utils/__init__.py

msyriac commented 4 years ago

@zonca @tskisner @mhasself I get "Permission denied" when I try to make an so_mapsims_data at: nersc:/project/projectdirs/cmb/www @mhasself would it be worth setting up ACL here as well?

tskisner commented 4 years ago

Just a reminder that the NERSC project filesystem is being transitioned to a newer and faster "community filesystem". /project will be made read-only starting at 7am Tuesday, Jan. 14 (during the maintenance window). See details here:

https://www.nersc.gov/REST/announcements/message_text.php?id=4287

The new filesystem will be online several days later with all the data synced.

msyriac commented 4 years ago

Thanks. Now I get "Permission denied" in /global/cfs/cdirs/cmb/www . @mhasself @zonca I'm going to temporarily set up shop in /global/cfs/cdirs/sobs/www/users/msyriac/so_mapsims_data .

mhasself commented 4 years ago

@msyriac You're not in the "cmb" group / project. And neither am I. Isn't "sobs" is the right place for this?

zonca commented 4 years ago

thanks @mhasself , @msyriac I copied your files to /global/cfs/cdirs/sobs/www/so_mapsims_data, I preserved the permissions, but better if you crosscheck.

msyriac commented 4 years ago

Looks good; updated the mapsims data urls.