search

LSSTDESC / DC2-production

Configuration, production, validation specifications and tools for the DC2 Data Set.
BSD 3-Clause "New" or "Revised" License
11 stars 7 forks source link

Issues/286 #311

Closed wmwv closed 5 years ago

wmwv commented 5 years ago

Adds a simple script write_gcr_to_parquet.py that writes out a GCR-readable catalog into a Parquet file.

This script is meant as both a useful utility and a simple example of how to do this.

wmwv commented 5 years ago

@rbiswas4 You indicated some interest in this script at the last SN meeting. Can you give this a try -- ideally both by running it and by using it to figure out how to do this yourself.

I've jut tested against the DC2 Run 1.1 and 1.2 object catalogs. I anticipate that there may be some issues that arise with other catalogs that I have not tested. I encourage you to test against those as well.

wmwv commented 5 years ago

@rbiswas4 I've merged this to make the script available in master. I remain interested in your experience and testing and trying to figure out if this is addressing your motivating use case.