astronomy-commons / hipscat-import

HiPSCat import - generate HiPSCat-partitioned catalogs
https://hipscat-import.readthedocs.io
BSD 3-Clause "New" or "Revised" License
5 stars 3 forks source link

Support user-supplied run_stages on catalog import #377

Closed delucchi-cmu closed 1 month ago

delucchi-cmu commented 1 month ago

Change Description

Closes #361.

Adds an option to run only a selection of stages in the catalog import pipeline. This can be useful if different dask client parameters are useful for different stages of the pipeline. This will be friendlier than attempting to kill the pipeline exactly between stage executions.

Code Quality

codecov[bot] commented 1 month ago

Codecov Report

Attention: Patch coverage is 98.75000% with 1 line in your changes missing coverage. Please review.

Project coverage is 99.72%. Comparing base (eeebc94) to head (49b7689).

Files Patch % Lines
src/hipscat_import/catalog/run_import.py 97.43% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #377 +/- ## ======================================= Coverage 99.72% 99.72% ======================================= Files 26 26 Lines 1461 1481 +20 ======================================= + Hits 1457 1477 +20 Misses 4 4 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.