Switch to Prefect from GitHub actions?

UK-IPOP / open-data-pipeline

A pipeline for processing, enhancing, and sharing open datasets.

https://uk-ipop.github.io/open-data-pipeline/

GNU General Public License v3.0

1 stars 0 forks source link

Closed nanthony007 closed 1 year ago

nanthony007 commented 1 year ago

Would this process be simpler to run from Prefect instead of GitHub actions?

This poses two questions:

Run prefect locally or in prefect cloud? And what are the pros/cons of these options?
Save files in a file bucket or still upload them as releases?

The latter question really depends on whether or not we want to have a remote file storage system or not more generally...