Create 80 sq deg CatSim Galaxy catalog for sanity checks

[cwwalter]

This data set will be checked by @slosar for suitability for LSS studies

[cwwalter]

A detail just came up when we were discussing the mechanics of this in the weekly project simulation meeting that I wanted to note so we don't forget it.

For @slosar's test I think we believe we just need the galaxy model since we are testing if the clustering is OK even with the current tiling in our database. When we make the actual catalog for the simulation it should have more classes of objects (at least stars).

[slosar]

I had a brief communication with @danielsf on this: we want the pure god's view on sky catalog to check for basic sanity and then a 1 chip, 5 observations (or whatever we agreed) post pho-sim/post DM output catalog for another sanity check. We want the luminosity function and clustering and pz mocking to be in the right ballpark, but bulges and such, I don't care about those.

[danielsf]

(scratch that last post I just deleted; I'm not 100% sure I got the area of the catalog right)

[slosar]

A very simple question: this file has 22k objects in it, corresponding to the full survey of around 5million objects. Taking just "gold sample" r<25.3, I get 5000 in the sample or 1.25 million in the full survey gold catalog, which is 3 order of magnitude too few. What is going on here?

[danielsf]

Sorry. There was a bug in the generation code. I forgot to convert from radians to degrees when specifying my field of view. I will email you a corrected survey.

[danielsf]

(I deleted the old post to avoid anyone mistakenly downloading the bad catalog)

[slosar]

Thanks. Best if you leave it somewhere at projectdir at nersc so that is stays there for posterity. Can you also send me the coordinates and radius of your "circle" (so that i can generate randoms quickly).

[slosar]

Actually, yes: 1.25e6*(180/pi)^2~4e9, so we are fine! Haha.

[cwwalter]

Thanks! Once you guys have determined that this is made successfully can you close this and then discuss the evaluation in #4?

[danielsf]

I'm not sure what you mean by projectdir at NERSC.

[danielsf]

To answer your other question, I simulated at 5.16 degree circle at RA=120, Dec=-10

[danielsf]

I see that there is a desc/ directory in /global/homes/d/ at NERSC, but I do not appear to be a member of the desc group. Whom do I contact to be added to the group?

[cwwalter]

I think @slosar means here:

/global/project/projectdirs/lsst

that is where I put my directory. But @richardxdubois should correct if that is the wrong place.

[danielsf]

Okay. The catalog has been uploaded to /global/project/projectdirs/lsst/danielsf/test_80sq_degree_galaxy_catalog.txt.gz

The cosmology is the Millennium cosmology (Springel et al 2005, Nature 435, 629, arXiv:astro-ph/0504097), which is Lambda-CDM with

Omega_matter = 0.25 Omega_baryon = 0.045 Omega_curvature = 0 H0 = 73 km/s/Mpc sigma_8 = 0.9 n_s = 1

[slosar]

@danielsf Don't have permissions to access that file. Please move it to here /global/project/projectdirs/lsst/LSSWG/DC1/TestCat and make sure the full chain of permissions is r and rx for dirs.

[danielsf]

Okay. I have moved it. Sorry about that. The permissions on /danielsf/ were drwxr-Sr-x, so I'm not sure what the problem was

[danielsf]

I see.... 'S' does not imply 'x'. My mistake.

[cwwalter]

This is a bit off topic but @richardxdubois we need to have the umask setup so that people have read access by default to DESC members home and project directories at NERSC from other DESC members... This keeps coming up in various ways.

[jchiang87]

@cwwalter Is there a way of doing that aside from just having people put umask 0002 in their .bashrc or .cshrc files?

[cwwalter]

@jchiang87 Well, I guess should ask NERSC if there is a preferred method than just setting our umask but if that is the answer I think we should ask them to either add it to the default .*rc files or set some up DESC setup files ourselves that people should source. We are never suppose to touch the basic ones but always the .ext ones if I recall correctly.

[jchiang87]

ok. I'll file a ticket and ask what our options are.

[slosar]

Ok, I'll close this ticket and move to issue #4. If we need to reiterate, will reopen.