panoptes / panoptes-pipeline

PANOPTES Data Processing Pipeline
MIT License
9 stars 8 forks source link

Pipeline cleanup #77

Closed wtgee closed 3 years ago

wtgee commented 3 years ago

This wraps all the pipeline steps into a convenient command line application. The calibration step, which includes bias subtraction, background, plate-solving, and catalog matching, is performed as a single step and an assets folder is created per image processed. Currently on the prepare subcommand is implemented in this fashion.

Also creates a service (via Docker) to run the pipeline on Cloud Run. The service is based on fastapi.

Added enum based status for images in pipeline.

Slight updates to how metadata is stored in firestore.

Removed source-extractor based catalog matching in favor of photutils, which reduces dependencies and still provides consistent results.

Removed docs folder as this is just a service repo at this point.

Generic google entry point now does better passing/parsing of user arguments.