astronomy-commons / hipscat-import

HiPSCat import - generate HiPSCat-partitioned catalogs
https://hipscat-import.readthedocs.io
BSD 3-Clause "New" or "Revised" License
5 stars 2 forks source link

Use the original catalog schema in more reads/writes. #325

Closed delucchi-cmu closed 1 month ago

delucchi-cmu commented 1 month ago

Change Description

With data re-generation on epyc, this closes #319.

Solution Description

Forces the use of the original catalog schema for reading and writing the input catalog parquet files. This coerces data types in the same way we do for catalog import, and ensures that dtypes are consistent between the original and margin catalogs.

Code Quality

codecov[bot] commented 1 month ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 99.56%. Comparing base (8145fbd) to head (c5665b1).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #325 +/- ## ======================================= Coverage 99.56% 99.56% ======================================= Files 26 26 Lines 1370 1372 +2 ======================================= + Hits 1364 1366 +2 Misses 6 6 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.