apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.91k stars 1.01k forks source link

[Feature] support spark standalone deploy mode #4131

Open monrg opened 2 weeks ago

monrg commented 2 weeks ago

What changes were proposed in this pull request

Issue Number: #4130

Currently, StreamPark lacks support for deploying in Spark's standalone deploy mode. Adding support for standalone mode would enable better quick start and testing.

This enhancement would involve:

Extending deployment capabilities to include the standalone cluster manager.

Watching cluster status.

Benefits:

Simplifies setup for smaller environments without requiring a complex resource manager.

Provides flexibility for users to choose the deployment strategy best suited to their needs.

Expected Outcome: Users can deploy and manage Spark applications using Spark's standalone deploy mode, with proper documentation and configuration guidelines.

Brief change log

Add cluster model support spark standalone deploy mode

Verifying this change

Does this pull request potentially affect one of the following parts

sonarcloud[bot] commented 2 weeks ago

Quality Gate Passed Quality Gate passed

Issues
37 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
1.8% Duplication on New Code

See analysis details on SonarCloud