PrefectHQ / prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
https://prefect.io
Apache License 2.0
15.95k stars 1.57k forks source link

Support key-value metadata on deployments #9554

Open polivbr opened 1 year ago

polivbr commented 1 year ago

First check

Prefect Version

2.x

Describe the current behavior

Prefect currently supports adding tags to a deployment, but these are simple strings and are awkward to use for capturing metadata.

Describe the proposed behavior

It would be very useful if deployments (among other things) supported capturing key-value metadata, similar to kubernetes annotations or labels.

Example Use

This functionality would be very useful for processing events via webhooks. For example, I would like to be able to write an event-driven framework that would launch deployments in response to certain triggers. Rather than having to store the trigger conditions externally, it would be very handy if I could store the conditions as metadata attached to the deployment. I could imagine something like:

trigger-on: flow-event?state=completed&flow=<source-flow>&deployment<source deployment> or trigger-on: blob-update?<... parameters ...>

Which could be extracted and handled via custom code.

Additional context

No response

github-actions[bot] commented 1 year ago

This issue is stale because it has been open 30 days with no activity. To keep this issue open remove stale label or comment.

bpolivka commented 1 year ago

Ping

tekumara commented 1 year ago

Looks similar to #5735

github-actions[bot] commented 1 year ago

This issue is stale because it has been open 30 days with no activity. To keep this issue open remove stale label or comment.