PrefectHQ / prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
https://prefect.io
Apache License 2.0
15.99k stars 1.57k forks source link

A Pythonic way to publish Work Pool #12091

Closed mattiamatrix closed 3 weeks ago

mattiamatrix commented 7 months ago

First check

Prefect Version

2.x

Describe the current behavior

Infrastructure blocks can be published using publish_as_work_pool. Creating Work Pool is only possible in the UI or via the CLI, not in Python.

Describe the proposed behavior

Define Work Pool with a pattern similar to that used to create Infrastructure blocks

Example Use

ECSWorkPool(...).save("...")

Additional context

No response

serinamarie commented 6 months ago

Hi @mattiamatrix, can you talk more about a use case for this?