Full cleanup script

[damonge]

Write script that:

• Takes raw data
• Applies cuts as defined in #3 (basic cleanup of nulls/nans, extendedness cut, magnitude i_cmodel<25)
• Defines mask_1 by removing all areas below the magnitude cut in the 10-sigma depth map.
• Defines mask_2 using the bright-object flags in the data
• Defines mask_3=mask_1*mask_2
• Saves clean data into a file, ideally in fastcat format (we'll figure out redshifts later on)
• Saves masks into files.

[damonge]

@humnaawan @fjaviersanchez Some progress regarding the bright object mask. This is now implemented in flatMask.py, with an example of how to use it in HSC_BrightObject.ipynb

Also, thanks a lot for a great sprint week. Let's keep the momentum going!

[humnaawan]

@damonge great! @fjaviersanchez was working on a script combining the code from the notebooks to produce 10sigma maps, etc., so we should have the depth masks for all fields.

In the meantime, I can work on a script to produce the systematics maps based on the input. Is that ok? Also, we'll need to look at the limiting mags for different fields -- I'd be happy to do that once we have the data at NERSC.

Also, we dont have the metadata to look at the airmass, etc. Is that downloaded anywhere?

[damonge]

This is mostly done. Documented in README.