apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.91k stars 1.01k forks source link

[Feature] support spark standalone deploy mode #4130

Open monrg opened 2 weeks ago

monrg commented 2 weeks ago

Search before asking

Description

Currently, StreamPark lacks support for deploying in Spark's standalone deploy mode. Adding support for standalone mode would enable better quick start and testing.

This enhancement would involve:

Extending deployment capabilities to include the standalone cluster manager.

Watching cluster status.

Benefits:

Simplifies setup for smaller environments without requiring a complex resource manager.

Provides flexibility for users to choose the deployment strategy best suited to their needs.

Expected Outcome: Users can deploy and manage Spark applications using Spark's standalone deploy mode, with proper documentation and configuration guidelines.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct