search

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
11.06k stars 1.38k forks source link

Adding DockerSwarmRunLauncher to the available options #13406

Open motion-x86 opened 1 year ago

motion-x86 commented 1 year ago

What's the use case?

This will provide a way to scale dagster workloads horizontally for those operation a docker Swarm cluster.

Ideas of implementation

I assume the existing DockerRunLauncher will be a good starting point for this new runner

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

motion-x86 commented 3 months ago

Any updates on this thread?